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FOREWORD TO THE READER 



Thi« Evaluation Flndlnga voluma marka the aacond yaar that tha Auatln 
Indapandant School Dlatrlct'a Of flea of Raaaarch and Evaluation haa 
abatractad a major portion of Ita yaar 'a work In auch a cantral format. 

Our purpoaa In prlhnlng thla voluma la to connnunlcata quickly to 
daclalon-makara In tha Auatln Indapandant School Dlatrlct (and to 
other Intaraatad p«raona) tha overall raaulta of our raaaarch and 

evaluation work during the 1977-78 achool yaar. 

Thla year the Office of Reaearch and Evaluation haa Initiated a new 
dlaeemlnatlon technique which la dealgned to facilitate communication 
of and uae of Ita flndlnga. In paat yeara, complete Technical Raporta 
and complete Final Raporta were publlahed. Each of thane documenta 
waa lengthy and. taken together, preaanted the potential of "information- 
overload" to the reader. Thla year, In an attempt to. deal with thla 
potential problem, the complete Final Report format waa dropped and 
replaced with a vaatly ahortened Final Report Sunntary. Each Final 
Report Summary, approximately ten pagea in length, preaenta the moat 
aallent flndlnga of that evaluation project. In thla way, evaluation 
Information la preaanted In a conclae and uaeable faahlon. Of courae, 
the conadentloua declalon-maker will atlll want to have acceaa to 
the more detailed Information regarding evaluation methoda and flndlnga, 
which la found In the complete Technical Report and varlova Interim 
Reporta. Theae documenta are readily available from the Office of 
Reaearch and Evaluation. 

A chronological Index of all 1977-78 O.R.E. publlcatlona followa the 
Table of Contenta. Alao Included are Inatructlona on how to order 
coplea of thla Evaluation Flndlnga volume or coplea of any complete 
documents referenced. 

The purpose of evaluation In the Auatln Independent School Dlatrlct 
Is to provide uaeable Information for declalon making. We believe 
that better educational declalona In our dlatrlct can result from 
the atudy of this Information. 

Any auggestlona for Improvements to future Evaluation Flndlnga 
volumea are aollclted and welcomed. A form haa been Included with 
thla volume to help ua In thla matter. Ita return would be appreclatedj 
simply fill out, fold, staple and return by mall. 




Freda M. Hollay 
Director, Office of Raaaarch 
and Evaluation 
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X977-78 EVALUATION FINDINGS AT A GLANCE 



Evaluation Findings on ; All Evaluations Conducted In 1977-78 
Contact Person ; Freda M. Holley 
Sumroary of Evaluation Findings ; 

In some ways the title to this section Is a misnomer and the prescribed 
format Inappropriate. since the Intent here Is not to provide a comprehensive 
review of all evaluations conducted. Rather the purpose Is to look at trends 
or slgnlflcarit Issues that seem to emerge when all findings In all evaluations 
In ORE and national trends In evaluation and research are considered. Since 
the Director of the Office of Research and Evaluation Is charged with the 
Indepth re\ lev and editing of all publications of the Officet the I'ole 
provides a unique opportunity to provide this kind of overview. In the 
past this has been done In several ways: one year there was a separate paper 
and another a verbrl suimnary with overhead transparencies. This year this 
section has been added to this volume. ^ 

In the comprehensive examination of our evaluation findings this yeart 
the predominant Issues that seem to emerge are thz qatition 0^ tiint and 
iZi e^^ec^t on, ackizvmznt, tht tUtctA oi eoAly ciUZdhood idacatLon and 
pa^zntat invotvmtnt on lou) S-E-S and minoHAJty itudtnt atkizvomnt, tkt 
content 0^ tkz KiodinQ and othiA pKOQHxm oi tkz dUt/UxU, and thi 
mpo^tancz o^ 6taii comp^t^icy In all (Upec^ 6c}ioot iunctLoning 
and thz Kole. oi Viaining and accountabAJUty in that compttznay. Running 
through all these issues is the question of the utility and use of 
evaluation findings; thus the report will conclude with a discussion 
of the Ke^pdnAlbU>itLt6 oi thz Boahd and admini&tMou in tht a6e oi 
tvaluation iindinQA. 

TIME AND ITS EFFECT ON ACHIEVEMENT g 

Researchers Wiley and Harnischf eger (1974) concluded in their summary of the 
research of the literature on the relationship of the quantity of schooling 
to achievement that; 

In terms of typical gains in achievement over a yearns 
period^ we concluded that in schools where students 
receive 24 percent more schooling! they will increaa^ 
their average gain in reading comprehension by two-thirds 
« and their gains in mathematics and verbal skills by more 

than one third. These tremendous effects indicate that 
the amount of schooling a child receives is a highly 
relevant factor for his achievement. 

Moreover, current research on teaching has found, at least tentatively, that the 
way the teacher expends her time in the classroom has a strong ralationship 
to learning. Yet some observational research reports suggest that rather 
large amounts of classroom time are lost to instruction; Hughes (1959), 



is 



for Example, concludes that teachers In elementary school may 'Mevote 40 
percent or more of their time to minagement routines and malntalnliig order 
or control." 

Locally, ORE evaluations suggested that efforts at Individualization, team 
teach'^ng, and supervision of aides or student teachers may have resulted 
In an Increase In the amount of management and clerical duties required of 
classroom teachers with a concurrent decrease In student Instructional 
contact. It also appeared that multiple programs or new progranft, until 
well established^ nay have the same result. Moreover, It looked as though 
* a concomitant effect of a drop In achievement was occurlng. 

This was part of the framework from which ORE planned and conducted a study 
of tline use In Its major compensatory program evaluations during the 1976-77 
school year. The findings were rather devastating In the sense that they 
tended to confirm the magnitude of the time problem. The results of this 
study were well publicized both Internally and extisrnally. Graphs on a 
following page Illustrate the findings. Although there were many negative 
reactions to the findings, evidence seemed to Indicate that steps were 
being taken to Increase Instructional time. The Director of Elementary 
Education In particular seemed to be giving this high priority. The , 
Department of Developmental Programs contributed In various ways such as 
attempting to reduce the overlap of federal programs for Individual students 
using overlap data provided by ORE. A local television station even 
suggested that the administration was the "grlnch who stole Christmas" 
because of an erroneous story that schools were being required to drop 
% holiday activities to gain more Instructional time. 

Fortunately, the University of Texas Research and Development Center had been 
engaged In research In recent years that produced suggestions for teachers 
on reducing time In management activities. Throughout the year these researchers 
worked cooperatively with the school district through the Departments of 
Elementary Education and Developmental Programs to share their findings wltli 
teachers, principals, and other staff. Coordinators In the Department of 
Elementary Education developed a slide-tape pren^ntatlon using the R&D 
research and used It throughout the school system. 

At the secondary level where resources were not available to ORE to conduct 
observations on time use, an attempt to look at time was made by Including 
appropriate questions on a teacher questionnaire. Here too the problem seemed 
drastic with a possible loss of 15 days per quarter from Instruction to such 
activities as scheduling, management, assemblies, testing, and so forth. 
Because much of the loss of Instructional time at the secondary level seemed 
to be due to the demands of the quarter system. It appeared that little could 
be done at the secondary level. Too^ there were no available data on In-class 
time use. 

Despite the positive efforts going on In the district it the elementary level, 
t/t<4 6toMj otto has a villain ^tkt TtLXOA Lejgl6taMiAe.. In Its most recent 
session, the Legislature reduced the number of days In the school year so 
that the 1977-78 school year was only 175 school days rather than the former 

180. 
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Nov with the results, all In, the findings are most suggestive. 
InAViactioml tunt can be ^ncAeoAed. The data from this year's compen- 
satory education evaluation time study show rather dramatic Increases 
In the amount of time allocated to the academic subjects « The graphs 
below, one from 1976-77 and the other from this year, 1977-78, Illustrate 
the Increases, For example. Title I students received 24 minutes more 
Instruction dally this year over last In the basic skills/major 
content areas, non-Title I students In Title I schools received 
35 minutes more, and non-Title school students received 23 minutes 
more* 





These findings were In general replicated at the SCE sixth grade 
schools. In addition, when comparisons were made between two schools 
who had also Increased the length of their school day voluntarily In 
order to Increase the amount of available time, It wau found that 
State Compensatory Education students In 7.0 hours schools received 
substantially more Instructional time In reading/language arts than 
did those In 6*5 hour schools. 

Thus, time for Instruction Increased In the elementary schools and 
colncldentally the achievement scores continued to rise. And 
there were general Increases In medlau achievement scores In grades 
1 through 6. 

There seems no reason to believe that this kind of Instructional time 
Increase occurred at the secondary level » although the resources of 
ORE did not permit observations to determine this as a fact. Thus« 
It Is fair to speculate that the high schools lost five Instructional 
days due to the legislative action with no moderating Increase In 
Instructional time. Achievement scores at the secondary level did 
decline. ( 



The junior high schools had Increases of one percentile In reading 
and math at the seventh grade level and neither gains nor losses at 
eighth grade. This moderates the possibility of the suggested relation 
ship at the secondary level except that one other factor which may 
have been having a strong effect at that level was an awareness of 
the new graduation requirements In reading and mathematics. The fact 
that gains came at the seventh grade level and net the eighth grade 
level may or may not suggest that eighth graders last year were already 
strongly aware of the requirement and gain due to that effect was 
realized at that time while seventh graders have just begun to understand 
Its Implications for them as well. 

Regardless of whether a positive achievement effect can be traced directly 
to Increased time at the elementary level, the Increased time Itself Is 
noteworthy. Even though 23 to 36 minutes per day may not seem like much 
of a gain, over a 175 day school year the gain In minutes would 
amount to from 8. A to 13.1 additional days In the school year. To give 
a further feeling for the significance of this. If current payroll costs 
for classroom personnel alone were used to compute a comparative cost 
for this, an equivalent number of extra school days could be estimated 
to cost {^^om a loi*} 0^ $1, 745,000 to a kigh 0(( $2,725,000. 

One might think from this that the evaluation costs not only for the 
time study, but for a number of evaluation activities might be considered 
a worthwlle Investment. Of course, however, such results coxild not be 
attained by data alone, but only through the system's efficient tiAe 
of such findings. 
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One cannot conclude that we have yet realized all the benefit that ve 
can from Increased attention to the quantity of Bchoollng. For example, 
low S-E-S students typically do not have good attendance, particularly 
at upper grade levels. This Is Illustrated In Figure 3. (As an aside, 
this figure doesn't show It, but figures for males and females are quite 
different and Interesting.) Of course, the relationship bltween attendance 
and achievement Is complex, despite the seeming simplicity In Figure 2, and 
we do not know the direction of 
the cause nor the origin. 
Nonetheless, attention to 
attendance would seem to be 
warranted. Parental Involvement 

activities t r programs such as 

that at Martin might be considered. 



My conclusion would be that 
the Legislature might well 
rethink Its action on the 
school year, and we should 
continue to pursue ways to 
Increase Instructional 
time • 
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OF DAYS ABSENT BY 
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THE EFFECTS OF EARLY CHILDHOOD EDUCATION AND PARENTAL INVOLVEMENT 



There were positive signs of achievement Improvement for low S-E-S and 
minority achievement in this year*» evaluation findings. This in 
itself is encouraging (See District Priorities Summary later in this 
volume.), but a few areas are particularly interesting. 

Parent Involvement has been particularly difficult to achieve in Title I 
schools and in sixth grade schools where minority children are bussed 
in. Past evaluations have documented staff feelings of despair about 
improved parent involvement and this year's State Compensatory Education 
evaluation indicates that sixth grade schools still have this feeling. 

However, both Title I and Title I Migrant evaluations indicate this 
year that parent participation in the required Parent Advisory Councils 
has increased dramatically over last year. 

In addition, Title I schools have piloted an "At Home Program" which 
Involves parents in the education of their children through having 
parents work with children on a set of lessons. Students in this 
program achieved established objectives in most grade levels; in those 
where objectives were not achieved, measurement problemS.may well have 
been the problem (Where test levels changed, objectives were not 
achieved,). This achievement was particularly noteworthy because the 
objectives for thip program were set higher than for the general Title I, 
yet objectives were achieved at mote grade levels by the At Home 
than by the Title I program. The graph ftelow illustrates first grade 
achievement for the At Home Program and for the overall Title I program. 
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Figure A. FIRST GRADE ACHIEVEMENT FOR 
TITLE I AND THE TITLE I 
AT HOME PROGRAMS. 
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One bright spot In most of our compensatory programs has always been 
pre-flrst grade instruction. Title I students in kindergarten have 
typically changed their achievement from an entry point equivalent to a 
low L-E-S average to an exit point equivalent to a middle S-E-S 
average. The same results were demonstrated again this year. In 
addition, new evidence of effectiveness came from a structured 
preschool program. To quote from the Migrant Evaluation: 
"If one accepts the assumption that students should maintain the 
same percentile from year to year if they maintain an average growth 
rate, the migrant pre-kindergarten students tested in English clearly 
made over a year's gain in six months. The students tested in Spanish 
moved from the 16th percentile on the pre-kindergarten norms to the 
20th percentile on the kindergarten norms also demonstrating over 
a year's growth in six months." In examining the various kinds 
of preschool programs being tried, however, it appears that a 
structured curriculum and well-tnanaged classroom are Just as necessary 
to rerults here as in later grades. Too, start-up problems can obscure 
hopes of achievement benefits for these programs In the same way that 
evaluation has demonstrated in programs of other types and other levels. 

THE CONTENT OF READING AND OTHER SUBJECT MATTER AREAS 

« 

New developments in research on teaching and learning give greater attention 
to the actual content of Instruction being delivered. As evaluations < 
have considered the effects of multiple programs, ipultlple curricula, 
and the problems of Integrating these across schools as children transfer 
in and out of schools over the years, the conclusion that these have to 
be Important aspects of achievement is almost Inescapable. 

ORE made its first attempt to look at curriculum content two years ago 
when final exams were analyzed in the Secondary Curriculum (Quarter System) 
Study to see to what extent courses seemed to conform to currlcultim 
guides. In 1977-78 Title I and State Compensatory Education evaluations 
surveyed teachers on such things as the materials they used, their training 
In reading, their use of that training, and so forth. The variety 
discovered is of considerable interest. 

It seems possible that some of these variations may be related to student 
achievement. It is the current intent of the Office of Researci and 
Evaluation to pjrsufe this Issue further, in the coming year for leading 
and perhaps for other subject areas in the years beyond. 



STAFF COMPETENCY 

Through all the evaluations that ORE has conducted over the past years 
seems to run a thread that tleci good results and bad results back to the 
competency of those involved in the programmatic efforts. Sometimes a 
lack of competency is due merely to a lack of experience and at others times 
it appears to be a matter both of ability and training. 



Our evaluations In 1977-78 again offer multiple Instances in which 
the conpetency of thosIT working in the programs can be surmised. 
For example, one report has test results showing dramatic gains 
in most classrooms and an almost opposite picture in one classroom. 
Observation data for the program documents classroom activities which 
seem clearly related to that lack of results. 

ORE doea not have the resources nor should it have the role of translating 
Its data such that It can be used for personnel evaluation. However, 
nie wise reader and the good manager whether of a program or a school 
will think about the Implications of data he receives at his level 
for personnel evaluation. The new personnel evaluation system 
recognizes "secondary data" which merely indicates for the 
personnel evaluator a problem to follow up, document, and take 
steps on or disregard. The d.ita from ORE falls very much In this 
category. It never proves competence or incompetence, but it can 
suggest a possiblity of competence or incompetence. The ability 
to understand and interpret the data he is given then is a crucial if 
skill that all administrators should have. The new Professional 
Personnel' System recognizes this as a competency for administrators 
and will provide at least initial training for the competency. ORE 
has become more and more convinced that any good administrator 
training program ought to have at least one introductory course in 
statistics. A course in research design because it teaches the 
fundamentals of data use and interpretation would also be a good 
Investment for most administrators in today's Complex world of 
information overload. Most administrators seem to recognize this 
. need too for it is one of the training needs they have expressed 
In relation to the new Professional Evaluation System. 

ORE findings continue to suggest also that accountability has a 
real role in achievement and productivity. Standards need to 
be high and living up to the standard required. This Is Just as 
evident for students as for staff. When faced with a minimum 
competency graduation requirement, students improve their performance. 
When standards are reduced, performance nay well decline. Relaxed 
course requirements at the high school level seems to be associated 
with SAT decline; the graph on the following page seems to suggest 
relaxing grading standards may alii* be associated with a decline 
in ACT scores. One wishes that longitudinal data were available for 
similar studies at other grade levels; it is possible, for example 
that the use of a more rigorous achievcanent test such as the STEP will 
over a number of years produce higher learning levels. 
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Figure 5. REPORTED GRADE POINT 
AVERAGES AND ACT 
SCORES 



ORE suspects then that if the district ds to improve the quality of 
its professional and administrative staff as called for in one of 
the three current priorities, such findings need to be considered. 
Accountability as well as evaluation is required. 

THE USE OF EVALUATION FINDINGS 

As suggested above, evaluation findings may serve multiple 
purposes in the district including that of accountability. The 
Office of Research and Evaluation can only provide data in any 
accountability system. The use of that data or information is 
necessary by all those who receive it if Improvements are to 
result. Over the past five years, ORE has seen an increasing 
effort throughout the system to accept that responsibility for use. 
One cannot but believe that some of the positive results evidenced 
are due to the Increased use. 

When ORE examines why the Increase has occurred, there seem to be 
two reasons. The Board and Superintendent have ttitdnoji to and 
Atudicd th^ Xt&tU.t^ and they have dejmndzd ' that tho^e. n.e.poAting to 
thm do tfie 6amz. Board members have 'epeatedly In&^^ttd upon knoi/Otng 
hoM XtiuJbU had been and (OeAe to be ttsed. The Superintendent adopted 
the 6afm ^tanat mXh the. Gablmt and thty ioZlomd through. 

The second reason is that ORE has been able to produce findings that 
do have utility. Although ORE has never had excessive resources, it 
\\AB been possible through the blending of district and federal program 
resources, through calling on research resources external to the district 
such as the University of Texas Research and Development Center, and by 



carefully deflignlxig its evaluation designs to take the bes^ advantage 

of those it dbasjm ORE^s localVbuidget for the studies in this 

volume was $3557000 which represents roughtl^y •03X and certainly less 

4.han 1% of the district budget~not an excessive amount for an organisation > 

to allocate both to quality control f^nd research. It is npt surprising 

either that the best findings to come ou^ of the office have cbma ' 

from federal program evaluations vherre reeources have been somewhat 

more adequate. . . ^ 

Considering these fa<:ts» it appears to ORE that if evaluation findings 
are to be used> the fit^ilngs must b^ usable am) the organization must 
recognize them and iisist on their use. Teachers and administrators 
^ xdt in a world with many demands which compete for their time; the 
organization must provide the structure which focuses their efforts 
on the most Important goals. There is some evidence that the priority 
system performs a part of that function. The personnel evaluation and 
accountability system can provide the other. 

In ^urmoAy, it apptivu that It l& tht ^upon&iJbltiti) oi the. BooAd and 
tht SupeAA.nte.nde.nt to pay heed to thz zvatuation ilndlnQ6 and to 
pfu}\)idz ^yhtem> \/o^^i£.h^pe)mit them to AzqiiOLZ thz oAe oi e.\jatmtion 
iintUng^ by the ejntUit ^y^tem. The positive results that AtSD has 
experienced In several priority areas this past year would seem to 
be a result of the accept^snce of that responsibility by the Board and 
the Superintendent and the allocatlph of their scarce resource of 
time to th3 actions required. 
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FINAL REPORT 



Evaluation Findings on ; District Priorities 

Contact Person: Freda Holley, Catherine Chris tner, or Jane Ogden 
Summary of Evaluation Findintts ; 

On August 1, 1977 after a prolonged process of receiving staff and 
community input, the Board of Trustees formally set three priorities 
for the district for the 1977-78 school year. These were: 

• Improve the basic skills of students in reading and math, 
including reading in the areas of language arts, math, 
social studies, and science. 

• Assure that Austin I.S.D. has highly skilled teachers and 
administrators by improving the evaluation system and 

e: phasizing competencies. 

• Improve the achievement of low socio-economic -status students 
and minority students. 

It is the purpose of this report to summarize the data available from all 
other ORE reports and from the specific separate reports prepared on 
each of the areas above in order to specify how well the district has 
achieved the priorities established. In addition, particular information 
collected on the priorities process itself will be presented. 

Priorities Process 

The intent of the priorities process is to provide direction to the 
organization in such a way that in addition to carrying out its essential 
functions, it can direct and focus attention on a few limited and specific 
areas in which to make extraordinary progress. The evaluation question is 
whether the process has been 
accepted and implemented well 
enough that any progress made can 
be attributed to it. ORE col- 
lected data in two ways in order 
to make this determination. 
First, teachers, principals, 
instructional coordinators, 
assistant directors, and non- 
cabinet level directors were 
interviewed. Second, school 
goals were analyzed. 



Interviews revealed that the 
school staff agreed that the 
setting of priorities by the 
Board was a desirable process. 
As Figure 1 shows, this agree- 
ment ranged from moderate to 
strong across the various groups. 
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Figure 1: Staff ratings of agreement 
with priority setting by the Board of 
Trustees. 
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The moat recognized of the 
three priorities Is that of 
Basic skills while the least 
recognized is that of Teacher 
and Administrator Evaluation. 
Figure A shows the recogni- 
tion rafjs of the i rlorltles 
by the various groups. 
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Figure 2: Reasons given by staff for agreement 
with priority setting by the Board of Trustees. 

As can be seen from Figure 2. the most frequently given reason for 
agreement is that the process gives direction and unity. 

The majority of all those 
interviewed also recognized 
all three prlorltleH correctly. 
Figure 3 Illustrates this, 
but also shows that on 
this item as on ail others, 
teachers are both the least 
Informed and the least in 
favor of the process. Still 
a remarkable number could 
recognize all three. 
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Figure 3: No. of priorities recognlaed 
correctly by the various groups. 



Figure 4: Recognition rates for earh 
of the three priorities. 
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All those Interviewed were asked to Identify specific efforts mad(i 

to address priorities. While almost all those interviewed could identify 

activities carried out related to priorities, few could pinpoint activities 

newly initiated or designed to address priorities. Exceptions were 

the listing of priorities on the staff directory, budget sheets designed 

to relate expenditure^ to priorities, and activities related to the development 

of the personnel evaluation system. 

In addition to the interviews, copies of the school goals were secured 
and analyzed. This was undertaken, because both the Director of Elementary 
Education and the Director of Secondary Education are known to have 
stressed the priorities in their directioj^s to schools for the development 
of school goals as well as to have stressed their importance in principal 
meetings throughout the year. Also, school goals appear to be the best 
mechanism by which to focus and direct school and classroom attention on 
the achievement of priorities. * 

It is apparent that even using very rigid standards in the analysis ( goal 
must explicitly state a priority or subdivision of that priority.), school 
goals do highly reflect the priorities. Well over half of all goals met 
the criteria as can be seen from Figure 5. Thus, it is evident that the 
Departments of Elementary and Secondafy Education are successfully focusing 
school direction on the district pri'^orities. 



Gtoups of Schools 


Percentagf.a of goals which refer 




to district priorities 


Elementary Area 1 


38% 


Elementary Area 11 


43% 


Elementary Area III 


46% 


Elementary Area IV 


52% 


Elementary Area V 


53% 


Title I Schools 


44% 


Non-Title I Schools 


49% . ) 


All Elementary Schools 


47% 


High Schools 


58% 


Junior High Schools 


56% 


All Secondary Schools 


57% 



Figure 3: Percentages of school goals which 
directly refer to district priorities. 
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Priorities Achievement 



It Is not the Intent of this section to assign grades to the district foy 
its achievement in priority areas since the priorities are far too complex 
for that, but it la hoped that a feeling for the progress made toward the 
priorities can be conveyed. In addition, some evaluation of the steps taken 
to bring the district closer to the outcomes will be attempted. 

In general, the Office of Research and Evaluation would have to conclude 
that a fairly high degree of progress has been made on the basic skills 
priority and on the low S-E-S and minority achievement priority.. The later 
progress is particularly gratifying since this is an area in which not only 
Austin, but other urban districts as well have failed to see Improvements. 
In neither area, of course, is the picture entirely positive and some conflicting 
data does occur. Particularly at the senior hJ:gh school level this year, 
declines In achievement scores are discouraging. Although good progress has 
been made on the teacher portion of the teacher and administrator improvement 
priority, ORE has little data to indicate progress toward that portion of 
the priority related to administrative evaluation. ORE was unable , within 
its resources, to collect data specific to this eloment in 1977-78; however, 
the evaluation design for the coming year allows for this. 

A brief discussion of achlevemelit in each of the priority areas below simply 
summarizes the more elaborate information provided in the sections of this 
volume specific to each priority area or to programs falling within the 
priority area. 

Basic Skills 

Our prime measures of basic skills achievement are the California Achlevonent 
Test (CAT) at the elementary and junior high level and the Sequential Tests 
of Educational Progress (STEP) at the senior high school level. 

Achievement in the elementary 
grades Improved dramatically in 
both reading and math. The 
adjacent figure Illustrates the 
gains in reading. The junior 
high schools also evidenced slight 
gain in seventh grade reading 
and math and held steady in eighth 
grade. 

Achievement at the senior high 
schpol level is not so encourag- 
ing' There are nine subtests 
comprising the STEP battery. 
Across four grade levels, there 
are thus 36 changes that can occur 
In dlstrlctwlde median scores. 
Of these possible changes ther^ 

Achievement In grades 1-6. 
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were four median gains, eleven medians remaining unchanged, and twenty-one 
median losses. The most drastic declines came at the twelfth grade level 
where all medians for all subtests declined; this senior decline may, however, 
have been a result of an excessive absentee rate, particularly severe at 
Anderson High which has many of the district's highest achieving students. 
(See the Basic Skills summary later In this volume for a more detailed dis- 
cussion of this problem and Its effects.) 
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The four gains 
came equally 
at tenth and 
eleventh grade. 
The figure to 
the right 
gives some 
feeling for 
the pattern 
of senior 
high achievement. 

The figure 
below gives 
a summary 
of the 

dlstrlctwlde 

achievement 

picture 
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Figure 7: Dlstfrlctwlde STEP median percentile 
scores for all senior high tenth graders. 



In reading and mathematics 
across all grade levels. In 
totals the picture Is still more 
positive than negative, but most 
of t\ e gain Is accounted for 
at the elementary level. 



FlRure 6: District Achievement 
In Reading and Math, Grades 1-12. 

repeated here. This Is an Important Issue, 
section should be made. 



There are complex reasons as 
always to account for the achieve- 
ment picture we find this year. 
The mostiijLlkely explanation Is 
related to the time available 
for Instruction. This Is 
discussed In some detail In 
the preface discussion 197"^ --78 
At A Glance and will not be 
however, and reference to that 



In addition to these two achievement tests we also have two other tests 
serving as Important measures of progress on the basic skills priority. 
These are the Scholastic Aptitude rest (SAT) taken primarily by high 
school applicants to more prestigious colleges and the American College 
Achievement Tests (ACT) taken by those Interested In other colleges. These 
are voluntary tests In part although they are required by a number of 
colleges for entrance. * 
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ThttM measures too are discouraging. 
The SAT scores for 1978-79 are 
not yet available, but 1977-78 
scores were again down continuing 
a multlyear trend, still the 
district remains well above 
the national average for SAT 
takers. The graph at right 
Illustrates the trends 
in the math and verbal sections 
of these tests. 

The ACT picture Is slightly more 
encouraging with the 1976-77 scores 
showing Improvement, but with these 
scores remaining well below national 
norms . 
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Figure 9: Mean SAT scores 
for AISD and National SAT- 
takers . 



A final measure of achievement conges from our former student questionnaire. 
Here one-year graduates tell us how they are faring. Of these students, 
65% are attending some type of post-graduate school with fully 74Z being 
In a four-year college or university. As a measure of their high school 
preparation, most students felt thtelr courses have prepared them for college 
except In the area of writing essays. The figure below Illustrates their 
agreement with satisfactory preparation In the major academic areas. Despite 
their ratings In these areas, fully 47% of all students felt that high school 
graduation requirements should have demanded more of than. Seventy-three 
percent (73%) of these saiAe students felt that their high school had adequaaely 
prepared them for thei r present activities. 

Strongly 



All Graduates: 



Disagree Disagree Agree 



Strongly 
Agrea 



The high school graduation requirements 
should have required more, of me. 

Overall, high school adequately prepared 
me my present activities. 
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Graduates In School or College: 



I wrote enough essays to prepare me for 
college writing. 

My Language Arts courses required enough 
of me to prepare: me for college 

My Mathematics courses required enough of 
me to prepare me for college. 

My Social Studies courses required enough 
of me to prepare me for college. 

My Science courocc ror.uircd enough of mo 
nrnparo me for coUoc^o. 



20% 
8% 
9% 

6% 

6% 



33% 
29% 
20% 

18% 

25% 



38% 
54'i 
51% 
66% 
5M. 



9% 
9% 
20% 
10% 

m 



Figure 9: AISD gradunuco ratlnp.o of hlch ochool nctlviticn. 
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Low S-E**S and Minority Achievement 

As yet no concrete way to Identify students as low S-E-S In any feasible 
manner has been Identified* Therefore, the Title I school population 
continues to be the population to which we must refer primarily In considering 
this question. Although this Is one feasible way to look at this question, 
the fact remains that many students outsire the Title I schools fit this 
description ddd nkany who are there do not. Because minority status can 
be easily Identified on student records, many analyses that cannot be 
done for low S-E-S students can be considered for minority students and 
there Is considerable, but not complete overlap between these categories. 
These constraints need to be considered in looking at the data we have 
on this priority. 



Overall minority achieve- 
ment continues to be 
lower than Anglo student 
achievement. In general, 
Anglo students score 
highest, Mexican-American 
students score slightly 
higher than Black students 
and Black students score 
lowest. The figure 
showing achievement 
on the Math Computation 
section of the STEP 
Is Illustrative ^of 
the manner In which 
these groups achieve 
In all sut^Jects at 
all grade levels. 

The dlstrictwlde 
picture on STEP 
achievement shown 
on a previous page 
In Figure 7 Is also ^ 
an Illustration 
typical of Anglo 
student achievement. 
The picture on 
minority achievement 
is slightly more 
positive for both 
Mexican-American 
and Black students. 
The two figures on 
the next page show 
a larger number of 
gains for Mexican- 
Americans and Blacks 
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Figure 10: Median percentiles 
of 9th, 10th, 11th, and 12th 
grade students on the STEP. 
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than for Anglos. Blacks had a total of 14 gains, Mexlcan-Amerlcau 9, and 
Anglos only 8. This may to some extent be explainable statistically Y 
the fact that Blacks start out below the median and Anglos above. 

On the CAT in grades 1 to 8 ♦gains were even more dramatic. Out a 
total of 32 possible changes in reading and math (8 grades x 2 subjects 
X 2 ethnic groups), 28 median gains were made. In some cases these gains 
were considerable — as much as 8 points and often 4 points. 
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Figure 11: Changes in Median scores from Spring 
1977 to Spring 1978 for all Black AISD high school 
students • 
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Figure 12: Changen In Median scores from Spring 
1977 to Spring 1978 for all Mexican-American AISD 
high school students. 
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The way these program fundi are expended la llluatrated in the figure 
below. There can be conalderable variation In the allocation to a 
achool baaed primarily on population, achievement level of Ita atudente, 
and the aoclo-economlc-atatua of the atudenta. 
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^'igure 14: Special fund distribution 
across schools, ttoritonttl linM represent 
median number of schools. Dots represent 
schools at extremes « 
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other favorable signs come from the fact that Title I has demonstrated 
better achievement than ever In the past from preschool to fifth grade 
level. 

More minority students also seem to be going on to college with percentages 
of minority students taking the SAT and the ACT both Increasing at the I.st 
reporting date. 

Why may It be that such positive signs are beginning to appear ? Title I 
concentrated their services more this year and streamlined their reading 
program Into three models. Overall the number of programs In Title I 
seems to have been reduced; too « the possibly negative effect from the 
overlap of programs competing for student time may have been moderated 
by reduced overlap* 

Undoubtedly, the overall stress on basic skills that produced achievement 
gains at the elementary level for the entire district has also had Its 
effect here. A dramatic posalbllicy Is that there has been Increased time 
available tor student learning (See 1977-78 at a Glande .) At the high 
school level, the minimum competency graduation requirement also seems to 
have had a very positive effect on minority achievement. Minority students 
'who had failed the 8th grade CAT requirement achieved many percentile points 
higher oft the STEP this year In 11th grade than did their counterparts last 
year. 

A total of fourteen specially funded programs are operating in the twenty-five 
Title I schools with extrd fundb of over three million dollars being 
expended there. As the table below illustrates, there apv ^rs to be a 
higher percentage of these special funds going to predominantly Mexican- 
American schools than to predominantly Black ur mixed schools. This is 
undoubtedly due to the bilingual program funding. 
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Despite this positive evidence of progress on the low S-E-S and minority 
achievement priority, the problem remains severe. Overall achievement 
Is low. This undoubtedly Is reflected In other problems these students 
experience such as low attendance, higher discipline rates, and Increasing 
drop-out rates. This latter problem Is one of Increasing severity over the 
last five years, especially for the Mexlcan-Amei lean student as Is 
Illustrated In the figure below. 
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Figure 15: Percentage 
of each ethnic group 
who are school leavers 
from 1972-73 to 1976-77. 



Highly Skilled Teachers and Administrators 

The progress that has been made on this priority consists primarily of the 
design and approval of a professional evaluation system which covers teachers, 
counselors, librarians, and other personnel who deliver services directly to 
students. Since the approval of the system in January, the Department of 
Staff Personnel has delivered an estimated 69 hours of training. 
Evaluation of the training to date reveals an administrative staff increasingly 
familiar with the contents and requirements of the professional personnel 
evaluation system. 

Whether this effort does result in increased skill for teachers and 
administrative staff will have to be determined in the next few years as 
ORE carries out the evaluation of its implementation. 
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Although the priority calls for Improvement in the evaluation 8> item for 
both teaching staff and administrators, the time available to the 
Department c * Staff Personnel and to ORE permitted no progress on the latter 
half of the priority. The collection of data and congruent literature 
searches on administrative evaluation are called for In the ORE evaluation 
design for 1978-79 • 

As a part of its baseline data 
collection, ORE noted tloat 
principals currently rate 
new teachers In the system 
as either excellent or 
satisfactory to a far higher 
degree than one would expect 
to find excellent and 
satisfactory teachers in 
a normal distribution. 
On another front, data 
collected this year from 
former students of AISD 
indicated that most 
students rate thetr 
teacher's competency 
as fairly high although 
a substantial number 
do not feel as 
positive. Former student 
ratings on five high priority Items for students are shown In figure 16 above. 

Conclusion 

Thus, it would appear that the establishment of district priorities, li part, hap 
resulted In real advances In each of the selected areas. Of course, each of 
the results found, except for the professional personnel evaluation system, 
may be attributable to a number of factors other than priorities. For example, 
the national trend now appears to be toward improved basic skills achievement. 

Based also upon the data collected In the Interviews, It seems likely that 
further progress might be made If all administrative departments followed the 
lead of the Department of Elementary and Secondary Education In determining a 
specific plan by which they might contribute to the district priorities. The 
development of a five year plan In the accreditation process, If properly 
pursued, may well be the vehicle for this. 





Craduacti' Rtiponiti 


Ttachtrt 


Agratd ^ 


Diiagrttd > 




Scrongly Agrttd 


Scrongly Diiagrttd 


Had knotfltddt and broad iiubjact 






arat bickgroundi. 

Prtatnctd laattrltl vtrbaily In citar 


in 


in 


manntr . 






Uted conmon itnte In InttrucClon. 


76X 


2AX 


Ratptcctd my rights & encourtgtd ret-< 




26Z 


ponilblllcy . 
Could tail 1^ studantt had Itirning 




3U 


problami . 







Figure 16: Former student ratings of 

their teachers on five selected competencies. 
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Publication No. 77.53 
(Ttchnlcal Report) 



ABSTRACT 

Title; ^ystemwlde Evaluation 1977-1978 Technical Report 
Cont act Person *. Jim Watkins, Catherine Christiier or Jane Ogden 
Noe of Pages ! 
Summary ; 

This Is the accompanying document to the following Final Report 
Summaries: 

District Priorities 

Basic SkllJn Achievement 

School Canpuv Longitudinal Trends 

Low S.EeS .Achleveiujnt - ' 

Profes&lwaal Personnel Evaluation 

Minimum Competency 

The technical report contains 19 appendices. Each appendix reports on 
the information collected by a specific data collection measure » These 
appendices , are: 



Appendix A 
Appendix B 
Appendix 
Appendix 
Appendix 
Appendix 
Appendix 
\ppendix It 
Appendix 1 
Appenuix 
Appendix 
Appendix 
Appendix M 
Appendix N 
Appendix 
Appendix 
Appendix 
Appendix 
Appendix 



Scholastic Aptitude T^^ats 

American College Tests 

California Achievement Teats 

Sequential Tests of Educational Progresa 

Bcehm Tests of 'Basic Concepts 

Metropolitan Readiness Tests 

High School Competency Tests 

District Attendance 

District School Leavers 

Dllbtrlct Graduation Rates 

District Bndgets 

Former Student Questionnaire 

Competency Survey 

Handbook L«v«ilopment 

Principal Interview/Teacher Quistionnaire 

New Teacher Checklist 

Disrrlct Priorities Interviews 

Proiressional Evaluation System Evaluator Training 

School Goals 



Publication Mo. 77.03 
(Fliul Report) 



ABSTRACT 

Evluatlon Findings on; Results of 1977-78 Priorities Survey of Austin 
School Pstrons. 

Contsct Person ; Freda Holley 

Suamsry of Evelustlon y.n< ngs : In May, 19^^ the Austin Board of Trustees 
tentatively establlsed the l§77-78 prlorltlei for the Austin I.S.D. In sn 
effort to seek public input and reaction to these priorities » they directed 
the Office of Research and Evalxiation to conduct a newspaper survey of 
Austin school patrons, soliciting their opinions about the tentative 1977-78 
priorities.. 

O.R.E- received 1,003 completod questionnaires. The %n:ltten connents of 
respondents to the Board indicated that, or the whole, Austin school patrons 
appreciated the opportunity to express their opinions on public education 
topics. 

The priority-ranking results revealed that those Austin patrons who responded 
to the survey closely agreed with the Board on the top three priorities for 
1977-78. Tlie Board had tentatively set the top three as: basic skills, 
low SES and minority student achievement, and teacher aud administrator 
evaluation. Austin school patroiis ordered these same priorities as 1, 3, and 
2. 

Written comments indicated a strong support of programs for the gifted and 
talented. These coooients corroborated the 14 rating given by all respondents 
to '*Develop more and better programs for the gifted and talented." 

The large number of write-ins for "Improve discipline in A. I.S.D. schools," 
-as well ai the large number of written comments about this topic, indicate 
that Austin school patrons' concern about discipline should not be discounted. 



BASIC SKILLS ACHIEVEMENT 
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FINAL REPORT 



Evlufttlon Findin^fi on : Basic Skills 
Contact Person ; Jim Watkins or Jane Odgen 
Sumnary of Evaluation Findings : 

An examination of the achievement levels of the district in 1977-1978 was 
done by looking at the medians for each achievement test and the distribution 
of scores at both the elementary and secondary levels. 

California Achievement Test (CAT) results indicate that AISD school students 
in grades one through eight performed better on the CAT in 1977-1978 than in 
1975-1976 and 1976*1977. CAT medians for every subtest in grades one through 
three were above the national norms. In grades four through eight the lowest 
median was only five percentile points below the national norms. The 
districtwide median percentile scores of elementary and junior high school 
students on the CAT 

1) showed the strongest gains ia the median percentile at the fifth 
grade level with every subtest showing a higher median than in 
previous years, 

2) were the lowest at .the eighth grade and sixth grade levels » 

3) were strongest on the Math Computation subtest » 

U) were weakest on the Math Concepts and Reading Vocabulary subtMts^ 

3) showed no losses^ only gains or no changes for' both the Reading Total 
and the Math Total scores across all grade levels. 
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Figure 1: DISTRICTWIDE MEDIANS FOR 1975-1176 THROUGH 1977-1978 FOR EACH 
SUBTEST AT EACH GRADE LEVEL. 
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AISD 1977-78 m«dUn CAT Achltvmnt tcorM r«nga from tha 45th parcantlU 
to th« 76th parctntila. In oth«r words, in our pooratt «chlavln| tubjcct 
ar«a at uur w««katt gr«d« Itval, tha «v«r«g« AISD altnantary ttudant parfonit 
S%1U point! balov tha parforMnca of «n avar«ga atudant natlonwlda. In 
our bait achlavlng augjact our atrongaat grada laval, tha Avaraga 

parformanca of an AISD alanantary atudant la 26%lla polnta hlghar th«n tha 
parformanca of an avaraga atudant natlonvlda. Flgura 2 praaanta tha 
dlatrlbutlon of acoraa of tha AISD aanpla for tha Raadlng ToUl. If AISD 
parformanca wara Idantlcal to that of, tha natlonvlda noma, axactly SOX of 
tha icoraa would fall batwaan tha lat and 50th parcantlla and batwaan tha 
50th and 99th parcantllaa. Thua, aa tha flgura ahowa, AISD CAT acoraa 
tand to ba mora concantratad In tha uppar parcantlla rangaa until tha 
alxth grada when an approxlnate balance batwaan the uppar and iowar halves 
occurf . 
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Figure 2: PERCENTAGE OF STUDENTS, BY GRADE g SCORING IN VARIOUS PERCENTILE 
RANGES ON THE CAT READING TOTAL IN 1977-1978. 



Although there hav? been Increaaee in the median percentile icoret at each 
grade level tince 1975*1976| there is a general tendency for the diitrlctvide 
median percentile icoret to decreate from grade one to grade eight. However g 
this decline appears to be lessening. ThuSg as Figure 3 on the next page 
illustrates, the 4nK)unt of decline in scores from first to eighth s^*^^' 
for 1977-1978 was less than the amount of decline in 1976-1977 and 1975-1976. 



Tracking group data makes it possible to compare minority student achievement 
at each grade level in 1977*1978 with achievement data for the same students 
in previous years at earlier grade levels. The two year tracking group data 
indicate nhat the rate of decline in median percentiles from grade one to 
grade eight may be decrasing. Figure 4 on the next page presents the median 
percentile scores of t:ae AISD students in 1977*1978 and the median percentile 
scores for those s^une students in 1976-1977. 
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Figure 3: MEDIAN PERCENTILES FOR READING TOTAL SINCE 1975-1976, DISTRICT. 



OlAMi 

If7#-7T IfTT-TI 


RIADMD TOTAL 
HttUM IGOttt 


AMOUNT or 
CNANOI 


HATH TOtAL 
MKDUi iGoan 
1974^T7 lf77-74 


Ahomtt or 

CHAMI 


Ut 


i 


74 


47 


-9 


71 , 


49 


•3 


IM 


)N 


41 


49 




44 


41 


-3 


)H 




41 


)4 


-7 


* 41 


14 


-3 


( 


Ith 


SI 


la 


0 


14 


54 


-4 


Sth 


4th 


41 


44 


0 


49 


11 


♦1 




7th 


47 


10 


♦3 


44 


II 


♦3 


7lh 


•th 


50 


49 


•1 


44 


49 


♦1 



figure 4: IVO-YEAR TRACKING GROUP MEDIAN PERCENTILES OM THE CAT FOR 
READING TOTAL AND MATH TOTAL. 



The tracking group Achievement pattern li pertlculerlly itrong for the 
Reeding Totel. Although «t flrit glence It eppeeri th«t the tracking group 
■tudentf ere doing woree, expeclelly for the Meth Totel, It ihould be kept 
In alnd that « decreaie In ecorei from earlier gradei to later gradei li 
expected according to the dletrlctwlde pattern! llluitvated In Figure 2. 
That if, an Iverage itudent In the dlitrlct ifould drop ten percentile polnti 
fron grade one to grade tifo, placing hln at the 65th percentile, itlll 15X11 
point! above the national median. The tracking group loet nine percentile 
point! placing then at the 67th percentile, atlll 17%lle point! above the 
national median. Figure 5 preeent! a compatl!on of the tracking group 
achievement gain! and lo!!e! and the achievement gain! and lo!!e! of the 
dletrlctwld4 medlaria in 1976-1977 and 1977-1978. 
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Figure 5: COHPARISON OF TRACKING GROUP ACHIEVEMENT GAINS AND LOSSES AND 
DISTRICTWIDE. 1977-1978 ACHIEVEMENT GAINS AND LOSSES IN XERMS 
OF MEDIAN PERCENTILE SCORES. 



StquentUl TaotN of Educatloiul Progrtit (STEP) retulta indicate that AUD 
achool atudaata at each grade level did not perform aa well on the STEP in 
1978 aa the atudenta at the aame grade levela in 1977* The noat acute drop 
in achievement acorea occurred for the twelfth grade acroaa virtually all 
aubject areaa. In akilla areaa^ the moat acute drop occurred on the Social 
Studiea teat acroaa virtually all aecondary grade levela. S >e Figure 6 for 
the diatrictvide mediana for the laat throe year a. ^ 

The diatrictwide median percentile acrrea of AISD high achool atudenta: 

1) were lover than the nationwide norming aamplea at all grade levela ^ 
; on uirtually all akilla aubteata with the exceptiona of the' 11th 

and 12th grade Math Concepta mediana . 

2) were the weakeat on the Mechanica of Writing Total and the Engllfh 
' Expreaaion aubteata^ and 

3) were lower in more akilla aubteata at more grade levela than in 
1976-1977 or 1975*1976 with 9th» 10th, and 11th gride atudenta 
ahowing approximately aa many gaina aa loaaea and the 12th grade 
atudenta aho ing decreaaea on all aubteata. 

The performance of the bottom 25% of the AISD high achool atudenta: 

1) waa lower than the performance of the bottom 25% of the atudenta 
nationwide I 

2) waa relatively conaiatent in the 9th » lOth^ and 11 th^ gradea with 
that of the previoua year for the aama gradea » and 

3) waa lower in all areaa for 12th gradera in 1978 than for i2th 
/ gradera in 1977. 
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Th« performance of the top 25% of AISD high school etudents: 

1) wai lower than that of the top 25% of the nationwide normlng gample, 

2) when reviewed by grade ihowed the 9th graders remaining stable 
since 1976-1977, the 10th graders scoring slightly higher, and the 
11th graders scoring slightly lower. The top 25% of the 12th graders 
scores much lower on virtually all of the STEP subtest than In 
1976-1977, 

See Figure 7 for a graphic display of these trends. 



iiitiiiiiiiiiiiii 



MAIN CnrVTAlION 




1^ 



Figure 7: MEDIAN PERCENTILE SCORES FOR READING AND MATH COMPUTATION FROM 
1975-1976 THROUGH 1977-1978, DISTRICTWIDE. 



AISO's median high school achievement scopes range from the 28th percentile to 
the 54th percentile. In other words. In our poorest achieving subject area 
and at our weakest grade level, the average AISD high school student performs 
only as well as a student at the 26th percentile nationwide. In our best 
achieving subject area at our strongest grade level, the average AISD high 
school student performs as well as a student at the 54th percentile nationwide. 
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There It e general tendency for the 
median percentile rank scores to 
increase from the 9th to the l^th 
grades. That i8» grade eleven in 
AISD compares more favorably to the 
national norm group than does grade 
ten I and grade ten more so than 
grade nine. Figure 8 illustrates 
this trend. 

The Math Concepts subtest was the 
only one on which the median per** > 
formance of AISD students was higher 
(at gradflMM* and 12) than that of 
the national norming sample, AISD 
is particularly behind the natioilil 
norming sample at all high school 
grades on English Expression^ all 
Mechanics of Writing subtests and 
Social Studies. 

There is a general tendency for AISD 
scores to be more concenttated in the 
lowest ten percentile ranks » the 
bottoiDl quart ile and the lower half of 
the percentile scale than t|e 
nationwide aotinin; sample. This is 
parallelacl by aelAndency to have 
smaller proportions of students iu 
the highest ten percentile ranks » the 
top quartile and the upper half of the 
percentile ecores than national norming 
samples. A few exceptions to these 
two basic trends of score .distributions 
occurred on the Math Concepts » Math 
Computation^ Science and Reading tests 
at some grade levels. 
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Figure 8: 



MEDIAN PERCENTILES OF 
9TH» 10TH» 11TH» AND 
12TH GRADE STUDENTS ON 
THE STEP, 1977-1978. 



An examination of the campus wide medians revealed that the median scores 
for the largest number of schools for most skills areas fell in the second 
quartile. This is the quartile directly below the national median. In 
addition: 

1) the only subtest that did not reflect the above trend was the 
Math Concepts subtest which had median scores at each high school 
for all grades that were divided evenly between the second and 
the third quar tiles. 

2) a general downward shift in STEP medians from 1976-1977 is evidenced 
by the large number of schools that now have medians in the 2nd 
quartile rather than the 3rd. 
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3) thft number of achoolt having Mdlan fcorat In tht lat qumrtllt tuta 
remained the aame. 

4) the downward ahlf t in twelfth grade median acorea waa more character* 
la tic of achoola that had medlana that fell in the lat or the 2nd 
quartllea. 

For a preclae presentation of the overall relationahip between achievement 
at the different campuaea at each grade in 1977-1978 and achievement at theae 
campuaea for the aame grade in previoua yeara, refer to the Syatemwide 
Teating School Profilea for 1975-1976 through 1977-1978. 
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Figure 9: PERCENT OF SENIORS TAKING 
THE STEP OVER THE I>ST 
THREE YEARS AT EACH CAMPUS. 



Because there waa an overall 
d<:creaae aince 1975-1976 in STEP 
acorea, particularly at the twelfth 
grade level, the percent of aeniora 
taking the STEP at each high achool 
campua waa Ullied* Figure 9 preaenta 
the percent of aeniora taking the STEP 
at each achool over the laat three 
yeara. Aa can be aeen from the^ 
graphs the moat noticeable decline 
haa been at Anderaon, which ie 
typically a high acoring achool. 
The dlatrictwide achievement analyaea 
were then re-done excluding the 
Anderaon atudenta. Figppre 10 on the 
following page diaplayrthe dlfferencea 
in the medlana of the dlatrictwide 
and the dlatrictwide minua Anderaon 
for the Mechanica of Wricingi Total 
ind the Hath Computation, Theae 
particular teata were choaen because 
they repreaent the two baaic patterna 
that emerged from the anal ya la* -that 
the 1977-1978 medlana experienced 
leae of a drop from 1976-1977 medlana 
when Anderaon waa excluded and that 
the amount of decline waa the aame 
but the medlana aince 1975-1976 were 
lower. The baaic reaulta of the 
analyaea were that: 

1) the overall dlatrictwide medlana 
are lower when Anderaon la 
excluded, 
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2) 



the niost noticeable 
dlffetv'^nce occure for the 
12th grade sanple, and 




3) 



In the 12th grade, six of the 
nine subtests showed slgnlfl* 
cantly lower rates of decline 
when Anderson was excluded. 
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Figure 10: EXAMPLES OF HCW THE STEP 
MEDIANS ARE EFFECTED WHEN 
ANDERSON IS EXCLUDED. 
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Thus, it was not possible to come to 
a clear conclusion as to the 
effect that the decreasing percent- 
ages of seniors taking the STEP 
at various campuses has had on 
dlstrlctwlde achievement gains 
and losses. However, It Is certainly 
significant that excluding one campus 
from the sample notlceabley effects 
the achievement patterns. 



Tracking Group Data ; Ah examination of the median percentile scores of the 
two year tracking group students reveals that each consecutive grade level 
fron ten to twelve show progressively fewer gains and more losses over the 
previous year's scores. Both the 11th and 12th grade tracking groups showed 
only losses or no-changes over their median percentile rank scores of the 
previous year. In addltloi), all two year tracking group students considered 
together had more losses from 1976-1977 to 1977-1978 In Reading and Social 
Studies than In any other STEP skills tests. 

An examination of the median scores of the three year tracking group students 
reveals that 11th grade students of 1977-1978 showed an lncrease\n median 
percentile scores from 1975-1976 to 1976-1977 and no change from 1976-1977 to 
1977-1978. The twelfth grade students of 1977-1978 showed an Increase In the 
median percentiles scores from 1975-1976- and a decrease from 1976-1977 to 
1977-1978. 



College Admissions Tests 

AISD mean Scholastic Aptitude Test (SAT) scores have been consistently higher 
than the national mean score's. Since 1971-1972 there continues to be a decline 
in both the Verbal and Math scores across the nation and In AISD. The rate of 
decline of AISD Verbal scores parallels the decline of the national scores. 
However, In Math, Che AISD scores, although declining, are not going down as 
sharply as those across the nation. The AISD mean SAT-Math score In 1976- 
1977 was about 40 points higher than the mec^n SAT-Verbal score. The mean 
SAT scores for AISD and the national SAT- taking sample are presented In 
Figure 11 on the following page. 
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Figure 11: MEAN SAT SCORES FOR AISD AND NATIONAL SAT-TAKPRS SINCE 1969-1970, 



AISD and nationwide meani vera below the norming aample mean of 20 on the 
American College Teit (ACT) in 1976-1977. ,^In addition, thii y«ir'i AISD scorei 
were ilightly lower than the nationwide lample for Englieh, Social Studiei 
and the Compoiite icore, and lUbitantially below for the Natural Science. 
Thui, the pattern ii that the nationiide scorei are below Che national norms 
set by ACT and AISD icores are below those of the nation. As seen in Figure 
12, the mean composite score for AISD and the nationwide ACT-takers since 
1969-1970 have shown overall decreases. Comparison of the ethnic breakdowns 
since 1969-1970 and the declining! scores suggests that there is a strong 
relationship between decreasing scores and increasing minority participation. 

Comparison of colleae admission test achievement data a nd other achievement 
djiSJLL decline in college admission test scores is somewhat inconsistent 
with other achievement data for AISD high school students. ACT-takers are 
asked by ACT to estimate their overall CPA. These eftimations are self- 
reports. Since 1969-1970, estimated CPA's have been going up. There are .i 
few exceptions to this trend but they are generally very small decreases so 
that they are more than offset by the increases of other years. In spite 
of the fact that CPA's are going up, both ACT and 8AT scores are going down. 
This relationship is graphically presented in Figure 13 for ACT grade reports 
and ACT composite scores. 
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Figure 12: MEAH ACT SCORES FOR AISD AND NATIONAL ACT-TAKERS SINCE 1969-1970. 
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Figure 13: THE PERCENT CHANGE IN ESTIMATED OVERALL CPA AND THE ACT COMPOSITE 
SCORE OF AISD ACT-TAKERS* The percent chetige 1^ e ration with 199 
1969-base period (%ch«nge • (later dAte-1969 date ) 

1969 data ^ 
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In addition to tha inconiiitancy 
batvaan incraaiing 6PA and 
dacraaiing collaga admiiaion taat 
•corai, thara li alio an 
inconiiitancy batwaan th« dlattict 
wida STEP icorai and (ha AISD 
ACT and SAX nean icorai. Figura 
14 praianti a conpariion of tha 
math portions of aach tait. 
Figura 15 praianti a conpariion 
of tha varbal and raading 
portioni of aach tait. Ai can ' 
ba laan from tha graphi, linca 
1972-1973 both tha quantitativa 
(math) and tha varbal maan icorai 
Qf SAT hava daclinad itaad4.1y. 
Both math and Engliih portioni 
of tha ACT hava appaarad to 

69-70 70-71 71-72 72-73 73-7* 74-75 7J-76 76-77 77.7t more i(> lina *(ith tha 

STEP achlavanant pattarna. 
That ii, a ilight riia occurrad 
in 1976-1977. 



Figura 14: 



TEST SCORES FOR THE MATH 
PORTIONS 0 ' THE SAT, ACT AND 
STEP. Scorai vara raportad as 
Z-iJoraa, uains publiihar'i 
provided national maani and 
standard daviationi. 




Svatemwida Attandanca 

in 1977-1978 alamantary ich: ili 
had tha highait attandanca ratai 
and high ichooli tha lowait. 
Figura 16 on tha following paga 
ihowi thii pat tarn and alio 
tha vida variation among diffarant 
t:afflpuiai. Tha Junior high 
ichooli diffar by ai much ai 
9% and tha high ichooli and 
alamantary ichooli by 7%» 

Tha diitrictvide attandanr.a rata 
of 92.07L wai 1.2% lowar than 
that for tha 1969-1970 ichool 
yaar which had t a highait 
attandanca rata during racant 
yaari. Howavar, it wai 1% 
highar than tha low of 91.0% 
in 1973-1974. 
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Figura 15: 



TEST SCORES FOR THE READING 
PORTIONS OF THE SAT, ACT AND 
STEP. Scorai wara raportad ai 
Z -icorai, uiing publiihar'i 
providad national maani and 
standard daviationi. 
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Figure 16: ATTENDANCE BY SCHOOL IN 1977-1978. 'The point At th* top of 
each box-line represent the school with the highest percent 
Attendance. The upper box boundry represents the upper quartile, 
the crass-hatch through the box, the median, and the lower 
boundry of the box, , the lover quar tile. 

School Ltavert Data 

School leavers are students who 'withdraw from AISD schools before graduation 
and do not go bo other schools. . Laaver^ also include students who stop coming 
to. school without officially withdrawing. , 

The percentage of all students at all grad* levels who were leavers in 
, 1976-1977 was 2.8%. The percentage of leavers has increased steadily from 
^.42% U 1972-1973 to 2. 87% in 1976-1977, t^e latest year for which data 
was available. Most of the students who 'leave are at the liigh school level. 
In 1976 1977, 8.39% of AISD high school students were school leavers. 

former Student Questionnaire 

About 65% of the jempled 1976*1977 AISD graduates were attending some type 
of school nine, months after graduation. About 28% were' working and not atcen 
attending school; and about 7% were in the militaryi Job hunting^ or 
homemakers. This was essentially the same breakdown as ick the 1975-1976 
graduates i\ *^ ' 

Seventy- five percent of AISD graduates in both 1975-1976 and L976-i977 
believed high school gave then adequate preparation for their preseait 
activities. In the required areas. Mathematics and Language Arts stood out 
as the areas wliere students took courses they felt .were relevant. Science 
and Social Studies wfte -Judged far less relevant. 'In the elective areas. 
Vocation Cooperative Education, Dri*'er BducAtion, and Business Educatioh- 
stood out as the relevant aieas. Homeroaking, Foreign Languages and the Fine 
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Arti were Judged «■ being far lesi relevant. 

Deiplte graduates' Judgement of the general adequacy of preparation for 
college work, 257. to 507. of the 1976-1977 graduatei who were attending four 
year collegei felt that the core curriculum areai deiigned for college 
preparation were inadequate. Almost 507. of the 1976-1977 gradu tes and 65% 
of the 1975-1976 graduates also believed that high school cu uulums should 
have required more of them. 



Sunmarv of Basic Skills Evaluation 

f 

Aisd students in grades one through eight scored higher on the 

California Achievement Test (CAT) in 1977-1978 than in 1975-1976 or 1976-1977. 

1) This is true for virtually all subtest. 

2) Students in grades one through three scored above the national norms. 

3) More AISD students in grades one through five than nationwide score 
above the 50th percentile. 

AJID students in grades nine through twelve scored lower on the Sequential 
Tests of Educational Progress (STEP) in 1977-1978 than in 1976-1977. 

1) At all grade levels the greatest drop in scores was in Social Studies. 

2) The greatest drop in all subtests was at the twelfth grade level. 

3) More AISD high school students than nationwide score in the lower 
half of the percentile range. 

4) Each grade from ten through twelve made progressively fewer gains 
and losses ip. 1977-1978 from the previous years' scores. 

In four AISD high schools the percentage of seniors who took the STEP has 
decreased trastically over the three years in which the tests have been 
Siven. In the other five high schools the percentage dropped the second year 
then increased in 1977-1978 to near its initial rate. * 

In 1977-1978 high school students averaged only 53.5 days in class during each 
60 day quarter. This has riflen from the equivalent of 52. A days per quarter 
in 1973-197A, but is still below the high of 5A.9 days in 1969-1970. Junior 
high students attended an average of 5A.6 days per 60 day quarter in 1977-1978. 
Elementary school students attended an average of 56.5 days per quarter. 

AISD Scholastic Aptitude Test (SAT) scores continued a long range decline in 
1976-1977, while remaining above nationwide scores. 

AISD American College Test (ACT) scores increase in 1976-1977 after three 
years of declines, but remained below the nationwide sample; 

Declines in ACT and SAT scores seem to be inconsistent with marked increases 
In high school CPA, as reported by AISD students to ACT and with the STEP data. 
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From 25% to 50% of AISD'a 1976-1977 graduate! who went to four year colleges 
felt that their preparation Iri the core curriculum areai was inadequate for 
college work. Seventy-five percent of the 1976-1977 graduates believe high 
school gave them adequate preparation for their present activities, however, 
almost 50% believe high school should have required more of them. Of AISD's 
1976-1977 high school graduates 65% went to some type of school, 28% went to 
work and 7% joined the military, were job hunting or were horoemakers. 
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Conta nt ; 

Tha «valuation daiiga ii a oaa-yaar plaa of avaluatloa work for the 
projact. Tha tablt of coataati for this documaiit iacludai: 



I. Evaluatioa Daiiga Raviaw Fom 



II. Decision Questions 



III. Narrative Suamary 



IV. laformatioa Sourcai Suamary 



V. Suamary of Data to be 
Collected 

VI. Evaluatioa Time Reiourcei 
Allocatioa Suamary 



This foxn praeeati the oafflae of parioas 
who are reeponiible for some aspect of 
the project's iaplameatatioa and who 
have beea provided with relevant 
portioae of the deeiga for review tad 
conneat. 

la thii lectioa, ell of the daclsioa 
queitiona are stated aad are related 
to the relevant evaluatioa activities. 

This sectioa briefly describes the 
project sad the evaluatioa activities. 

The specific analysis procedures for 
each of the evaluation questions are 
presented in this section. 

This section contains a tloelina for 
the data collection activities. 

This section suomarlxas all of the 
evaluation work estimates (in person- 
days) by position, for each aspect of 
the evaluation. 



This design presents the evaluation plans for the examination of academic 
achievement in the district sad for the exaniaatioa of some of the factors 
relating to achievsmeat. The evaluatioa is iateaded to provide iaformatloa 
to district dttcislonmakars coaceraiag the adopted district priority of 
improving the basic skills of students in the Austin School District. 
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Tht •valiMtioA dAtigti fptclflti tha tnalyfif oi achi«v«Btnt tiitt rtfultf 
from tha-dlttrlct-adnlaltterad tatting program and also from othar 
tasting programs in which Austin stii(|ahts participat'a--tha Scholastic 
Aptituda last (SAT) and tha Amari can Coll aga lasts (ACT). Also axaminad 
ara soma of tha othar factors that ara ralatad to achiavsmant, including 
attandanca ratas, graduation ratas, and school dropouts. 

Tha infonnation that is providad will sarva as a dascriptiva suomary 
of tha school district's status during tha currant (1977-1978) school 
year. It will also provida information ragarding long ranga trands that 
may ba occuring in tha district. 
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AUSTIN INDEPENDENT SCHOOL DISTRICT 
CAMPUS LONGITUDINAL TRENDS 
1973-74 THkOUGH 1977-78 



The following pages present district suionary data for the achievement 
tests administered In the spring of each school year, to all AISD 
students In grades 1-12. The California Achievement Tests are 
administered In grades 1-8, and the Seijuentlal Tests of Educational 
Progress are administered In grades 9-12. Data for grades 1,3,5, and 
9 through 12 are available for only the past three school years, 
1975-76 through 1977-78. 
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1 
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wwm ' 
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— 
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— 1 
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— 


— -m^^ 
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. 





■ -mmii ' — 1 
••t 1 
• •t 1 












— 1 

1 



n ^ 20 SILE 



I - 10 MLF 



m 



3R0 QUARTiLt 



a6'4fLc 



MEDIAN 



62 iiil 



1ST QUARTILE 



26 41L6 



JTtJOfNTS T£5TgD 



395<» 



39(11 



3962 : 4054 " 
lli~il LE ^ 90 il l I" 

"3'j iKi 'Toninr 



3BD QUARTILE 



1ST OUARTII E 



ills amiT 
~2» *iLi ~^9~ii lX 



39«!> 

"anicr 

Vi~TrLT 



4062 

T9~irur 



NOMat^ Of 
ITuOtNtS nsTEO 



3M0 QUAHTILE 



VEDIAN 



not 1«72 



39*4 



tST QiJAHTILE 
COMMtNTS 



1 



U Hit 

2*~i i It 



16 41Lt' 



406i 

^■90-llLf' 



T lO "IIL6 



2» liiE " J* tur 



"90tLj~^rifui 



440] 
119 tUI 



! 7S ltd I 
1 so II 1.1 



i9 ltL£ ! M IILE 



440! 

TOTTCT 



ERIC 



4 



4 



PERCENTILE 
RANGE 



4CHl6veH|NT PKOFILIS CAADI 2, A.I.S.O. 
SCHOOL VHAK 



1 


- 99 VILE 




1 


- 90 SIlE 




1 


~ 80 MlE 




1 


- 70 MLE 




1 


- 60 MLE 




1 41 


- 50 MLE 




1 


- .10 '«ILE 




1 


- 30 'alLB 




1 


- 20 MLE 





1 - 10 Mle 




STUDENTS rtOTSD 



3R0 QUAHTILE 
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36 <ILE 



VIEOIAN 



1ST QUARTILF 



2* lilT 



7i u ur"m ~iTiT 



"Ti 4 ITT 



"mnT 



I *« tlLI 
■^40 4ILr 



Tr-|RT 
ID" II LI 

TnfTLT 





1 JTuoiNTjri'/rjo J>»« 3964 3956 






1 3RDQUAflTlL£ 4JU \ 79 4ILE ' 41 4lCf~~ 


ri* IlLl 


41 II LI ; 7! IILT 


1 MEDIAN : 52 4 1 Li >6 4iLj '60 ifLr" 


rsTiiLf— 


69 IIU 1 M ircFl 


1 iSTQUARTii.6 27 4Ue . it tlLC 1 it 4ILl ' .'.4 4tLl 


r6d 41 lE I 2S IIleI 






JTUUtNTS TIJTID 


3571 


3 952 


395S 


61^5 i 


6602 




1 3RD aUARTlLE 


79 4ILC 


79 f^r~ 


79 cue 


83 cue 


43 cue 


75 tUil 


MEDIAN 


50 41LE 


\i2 CI LI ^ 


^ 55 cur^ 


60 tlLI 


66 lUI 


|lLl| 


1ST OUARTILE 


21 «IL£~1 


26 cue i 21 CILC 


il 4Uf 


3i'ciLl 


M iiirl 



COMMENTS 
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PERCENTILE 
RANGE 



I s 

1 N I -~ ^- 



SCHOOL VIAA 



•lU 04TA 



19 76-7 7 1977-7* 



(NATIONAL! 



91 


- 99 "tlLE ' 1 


81 


- 90 *..ILE 


71 


~ 80 MLE 


6) 


- 70 '»ILE 


51 


- 60 %'LE 


41 


- SO MLE 



31 40 ^alLE 



21 - JO MLE 



1 - 10 r.lLE 
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MEDIAN 



1ST QUARTILE 



• ••••41 
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••• 

• •• 
--••^ 

•«•• 
•••••• 

• ••> 

«•• 



««• 
• •• 

•«• ' 
••• 
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— 
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NUMIIIR OF 
STUOINTS TtSTtD 
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MEDIAN 



1ST OUARTILE 



n»0 ' 379« 



s* II Li rmfLi 

30 4iL£ ' 33 iili 
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"IFTTtl 



STUOINTS TISTIO 






3834 


3799 


396 7 


«tLt 


JRO QUARTILE 






19 IILC 


Hi tin 


46 lILl 




1 MEDIAN 







60 It LI 


^60 ItLi 


46 iiL£ 


90 II LE 


J IST QUARTILE 1 


r • ^ 


29 IILI 


J2~«iLf 


3 7 tiii ^ 
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91 


- W MLE 


— 


81 


- 90 SILE 




7t 


80 MLE 




61 


- 70 Mue 


— i 


51 


- 80 »«ILE 
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- 40 MLE 
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PERCENTILE 
RANGE 
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8L 
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MEDIAN 



1ST QUARTILE 
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MEDIAN 



»ST QUARTILE 
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*l IILI 
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Trmr 

"3I~iTtr 
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25 IILI 



»1 II LE 

Tmrr 



a <tLl 

TTlaT 
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S« IlLl 
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TTlf 



COMMENTS 



erJc 



P6RCENTILE 


H 1 

T , 
A 


SCHOOL Yf4il 






NOFlM 
(NATIONAL) 


RANGE 
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1V74-75 


19/9«76 


l97»-7 7 

1 


L977«a7i 


91 -99 MLE El ^ 1 j 
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B 
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71 MLE 






1 — 
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• « t 







61 - 70 MLE 
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390 1 


37S4 . i7!4 
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75 iUi K kilt 


74 4fLl 


^7i tilt jtriftH 


71 IICT 


MEDIAN 




iO ilLE { 4ILE 


47 IILE 


52 tILE 


Si 4lL£ 




1ST QUARTILE 






II 4IIE 


^2 IILE 
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S79I 
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77 IILE 


$0 IILin 


«4 41 Ll 


'TS 41LI 
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-1 


^6 4 lie 


^6 lUE 




49 tlLE 1 S4 IIU 


M IlLf 
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23 illi 


19 IILE ' 


21 IILE 


24 <I<.E 


28 41LI 


21 4ILe 




STUDINTSTItTIO 




4129 


447i 


If 01 


3795 
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79 lllf 


3RD QUAKTILE 


-J 


74 41 U 


79 SILI 


77 II LI 


^ 7t itLl 


t? llLlH 


MIDIAN 


■ 


90 iiwe 


^1 II LE i 


h4 IILI 




^SillLf- 
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-1 
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PERCENTILE | t 
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71-80 MLE r!! 


I —www mmm 

• 
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' M8^*< •A^^ fi«« ^s^g 
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^inDOUAATILE it (J : 7« tlLE , «2 11 Lf ik till | 12 I1LI ' 


~7S IILI 
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f SO II Lf 


ISTQUANTILE iVilH it ilLt \ tl Ull \ il Ull \ 


\ ii IILI 


r » iiLff 




ITuOINrjTIITlD 1 




1 




.anodUAnriLE ! 41 LC 1 77 lUC 

— ! J 


1* ikl 
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14 41 LI I'Ts trcr 


MEDIAN , ^« CtLf 1 fill 9% lUf 


54 IlLf 


M IlLl.' M IILI 


!STouAnTiiE ; 21 iUi < U file 2^ IIIE 


H till ! iO 4111 1 li III! 




NUM9IA or 

iTuOi^ri nino 






;»«S 1 


179» 






3NO.OUA^T4L.E 


19 4ILS 


7» II LE 


ii liLi 


112 IILI 




7S IILI 


MEDIAN 


O <IL| 




'111 


n 4(Li i 


SI Ikl 


M 41LI 


1ST QiMRTILE ' 


22 ita 


17 iluTl 


20 nil 


i» Itll ] 


2*' 4111 


'24 IILI 
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O 






irr» 
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WgAOING rjTAL RESULTS 



ACHIfvEMCNT PHOI^ILfS CHAOI 9| A«t«StOt 



PERCENTILE 
RANGE 



I r 

! N . 
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I N ' 
I C 



SCHOUl YEAR 



NO DAU 



H7S«74 l9 7*-77 



91 ■■ W MLE 



(11 ■ 90 -i'lLE 



•T 



I977*fll 



71-80 '..ILt 



fil ~ '0 .ILE 



5- 



NOPM 
(NATIONAL) 




11 - 20 MLE 



I - to MLE 



I 



««« 



,««« 



5TU0INTS rtSTBD 
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" j754 




1 ■ 


3R0 QUAflTlLE 






^ 74 4IL6 


74 «IL6 j 79 41LE 
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MEDIAN 
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»d IlLl 


tST QUAftTlLE 
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"M ilU 


\i IlLl 




SruOINTS riSTCG 1 1 


4241 
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3R0 QUARTtLE 


^ ■ ■■ — 




72 II Lf 




' T* 11 Ll 


71 IlLl 


MEDIAN 




f- 


' 4* IILC 


ttLf . 


49 ilLl SO IlLl 


I'iT OUARTILE 






20 lilt 


' 22 llLl 


M 41 Ll 1 2f II lT 










4247 


3 75fe 


I70S 




3RD QUARTILE 


r 

k - 




li CIU 


7) 11 lI 


79 Ikl 


79 IlLl 


MEDIAN 






46 41 LI 
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U <tLl 


90 IILI 


1ST OUARTILF ' \ 


"24~?fLE"" 


24~4fLl~ 


iriiLi— 





COMMENTS 
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ACHliVlHfNT ^ROfUeS 6RA0I i, A.l.S.O. 



PERCfNTILE 
RANGE 



SCHOOi VfAK 



19T7«7» 



91 - 90 \ILE 



71 80 MI.C' 



6! - 70MLC 



51 - AO .ILE 



NOflM 



4! - 50 ^.ILE 





• ••• 
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-♦♦^ 
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mmm- 
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mnn 
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mmn 
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mmm 



21 - 30 Alii 



mmm 
mmm 



mmm 
mmm 



mmm 



mmm 



M - 20 ML£ 



1 - 10 ML6 



3R0 QUARTllE 



MIOIAN 



1ST QUARTILC 



— I74I~ 



I 24 <ILI 



i 71 II LI 
I SO II LI 



! » IlLI 



SruDINTt TUTtO 



31^0 QUARTll^ 



TTiiir^Tniir 



I II IIU 



MEDIAN 



!Sr OUARTltE 



T S I IL I 
SO II LI 



irooiNTS riiTio 



3R0 QUARTHE 



VIDIAN 



1ST QUA^TILC 



Trii cr-fFi-irapprr-nir 




COMMENTS 



ERIC 



ACHlEvfMiNT PKU^ILfS MAOl «« A.I.S.O. 



& 

: T ' 

PERCENTILE I ^ . 
RANGE 1 ; 


SCHOOl YIAil 


NOMM 
INATlONAU) 






19 75* 7* 


1976-77 




9K-MMLE ^ 1 












. 81-90 MLE M 












/I - 80 ^«ILC 




7.:;^ • 

•mm 


0mm 


01 > ^0 VLt S 1^,, 


W^^* 9^ »»» 

51 - dO MLE 

E>w»» ^•f* ■^♦^ »»»»»» ■ 


a\ Kn^-iic •••• nmmm 

41 * 3U .ILS •••• •••• M«t 


M »»» »»» 

-li in'^iip 

- <HJ nlLC 


21-30 MLE 


• mmm 
i«« mmm 


n 20 -mlE Q 


rM ^ i 

' ' ) 

1 
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NUMKMo* ^*i9 44,«o 4204 

ITUOINTITIJTIO ' 


3114 




3«0QUAHTILE '2 


7* fiLl U ItLl 

^vrmi 1 4T 411.1 


74 II cl 

41 4ur~ 


7S IILI 
~M IILI 




ISTQUARriLE ' 19 I' <1I>B ' 20 IILI 20 IlLI 


' 24 itli 


2S IILI 






1120 




" 3W0QUARTILE '^lUI IfiltH 7J*UI 


fi ItU 


71 IILI 


MEDIAN , Altl 1 O IICl 1 44 IILI 1 M «tLI 


4* IILI 


M IILI 


STQUARTILE i^tUi kkkili iillll 


22 IILI 


IS IILI 


fCf'^JwC* COHFAIHkNStUN 
Si SUITS 






suMim or 

tTuOINTI ritTIO 




4*19 


M*0 j 4204 


laiv 1 


3M0 QUAM1ILI 


t7» 4iLr 


U lUI ' 


1' U iMl "T U"4(Cr 


74 4IU 


7} IILI 


MEDIAN 




%* IlLl i S4 nil 1 4UI 


49 41 LI 


II IILI 


l«T QUAMTILE 




19 tUi j 20 f Ul I 29 till 20 till 


21 IILI 



COMMENTn 



ACHIiVl»«Nr ^HO^ILIS QHM% «• A.l.S.O. 



PIWCENTILE 
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(NATIONAL) 


RANGE . 
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91-99 ML.C Kp 
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•V 
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f 


71-90 NILE 












A1 - 70 MLI '^^ii** * 

51 - 70 




M9 


M^ 


SI 60 MLI 




B 
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• M 


^mm « 




41 - SOMUi 


I 


MM 




«M 


^M " 


, 


11-40 MUE 









W# 
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21 - 30 MUS 
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mmm ' 








•H— 
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o 


rM 

•M 


1 










1 • 10 MUl 
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! 




sTtoiNTsriiriD 
















3II0QUAIITIU 






«* IILI 1 74 1 LI 


74 IILI 


71 IILI 


Ji fILS 


MiOlAN 




in ua ' 


i> IKI 


41 IILI 




M IILI 


M IILI 


1ST QUAHTILI 






i» llcl 


' 14 IILI 


1 14 iki 


^12 4ILI"^ 


» IILI 




\ 










truOINTITIITIO 






4471 




SII2 - 




3110 QUAHTlLi 






ii IlLl 


44 ilLI 


74 IILI 


71 IILI 


MiDtAN 




H till 


M lUI 


IILI 


1 ^4 41LI 


4f IILI 


M IILI 


'ST OUAHTILI 








11 41 Lf 


21 Illl 


12 IILI 


21 IILI 




4 












NuMf IM OP 
|TUO<^ll|TI TIITIO 






MSI 




illO 




3110 CUAHTILI 




fi IlLl 


9f fill 




11 IILI 


71 IILI 


MCOIAN 




i4 IlLl 


4f ilL« 


47 Illl ^ 


47 IILI 


H IILI 


1ST QU^HTILI 


1/ lUi 


il ftkl 


14 illl 


14 IlLl 


1 1« IILI 


21 IILI 



COMMENTS: 
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ACHIIVIMNT ^^O^ILIS MAOl If A.UStO. 



PERCENTILE 
RANGE 



5 
T 

A 



SCHOOt VIAK 



91-90 MLl 



-.5 



l«7S«7« 



l»7*-77 I I977«74l 



<MATI0NAC) 



81 - )0 MLE 



71-90 MLE 



51 - 70 MLE 



51-60 MLE 



41-50 MLE 



31 - 40 '«IUE 



21-30 MLE 











000 
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*W 

090 
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000 

099 

99m 


^90 
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000 

000 

1 


000 

000 



I - 10 MLE 



NUMaCA OF 
STUDiHTS rtSTf D 



3RD QUARTILE 



MEDIAN 



%36ll 



1ST quARTlLE 



22 4ILE 22 llTT U tUi 



IlLl ' <S till 



3RD OUARTll,! 



MEDIAN 



i 75 4ILr 
^50 41 U" 



75 



50 



ITtf 

Tut 



irxiiT" 

ITTTur 



Tmrr 



ft ilLl 



1ST QUARTILE 



22 4II.E 22 fUl 2\ IKS 



VOrLT 
^ il 4iLl 



71 ilLI 



2% iUI II IfLl 



ITUOINTI rilTIO 



3RD QUARTILE 



MEDIAN 



1ST OUARTItE 



%171 



irmr 



77 



"TiTT 



w~ml r«v ttif 



j M5l 



2r4ui 21 lut ' mr 



Trurr 



vrmr 



nriiLr-TriT 



Tnnr 
♦nrrr 



inrcr 

M IlLl 

irtF 



COMMENTS 



ERIC 



AN 



MATH rjTU KfiSOUTS 



PERCENTILE 
R/>NGE 



NOAM 
INATIONAU 



9t - 9Q MCE 



61 


r90MLE 


71 


-80MLE 


61 


-70MLE ' 


51 


-60 MLE 


41 


- SO MLE 





31 - 40 MLE 



21-30 v.ilE 



11 --.20 \ILE 



1 - 10 \ILE 





mrcn i so iili 



1STQUARTILE Ol-^ ^» 26 SlUI 


^6" iluK i 21 41 LI ! » IILI 




NUMICN Of ' ' 4i la 

STuoisTiTirrli { 
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♦lit j 


3R0 QUARTILE *^ 


i9 ii(.e 


72 ttui 


t2 Itui 


ft tILI TSaiLI 


MEDIAN ' )^ 41 tl 


i* IlLi 


Mi tilt 


♦9 llci 


44 iia M IILI 


»ST QUARTILE ' ^ I liS 


U tlLl 


is itli 


2i <1LI 


21 ItU I 21 IILI 






iTuoiNTsnino 




4*91 . 




.>9r* 






3M0 QUAHTILI 


h 11 li 


n iiui 


19 IILI 


>« ltd 


12 IILI 


Tl IILI' 


MCOIAN 




o itui 


ii ilul 




SI 4UI 


M IILI 

inriT 


1ST QUAHTILE 


21 4UI 


20 liut 


26 lUI , 
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T- 



NOMM 
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91 90 ML£ 



81 
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71 


- 80 Wli 


61 
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F ] 
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41 


50 MLE 
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mm mm 
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mm% 
mmm 
mm m 
m^m 
mmm 





mmm 
mmm 
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mmm 
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1 - 10 MLE 



NUM«E« 0^ 
3TUOINT5 tE$TED 



^699 



4666 



3RD QUARTILE 



79 /7 IILE 79 4IUE 79 IIL! 



4979 



MEDIAN 



90 41 LE 
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ABSTRACT 

Title ; Austin Independent School District School Campus Longitudinal 
Trends, 1973-74 through \977.-78, Vols. I and II: Elementary 
Schools 



Contact Person ; Jane Ogden, Ph.D. 



No. Pages ; 
Sutmnary ; 

These\olumea are a tabular and graphic record of the California Achieve- 
ment Tests results In reading and math for each elementary and sixth grade 
school In the Austin Independent School District » for the past five years: 
1973--74 through 1977-78. District Summaries In reading and math at each 
elementary grade level are also presented. A forevard at the beginning of 
each volume is divided Into three major sections: 

1, A discussion of the limitations of the achievement data, Including 
an explanation of which groups of students were exempted from the 
testing, a description of the testing situations, and the methods 
used for scoring the tests. 

2, An explanation of how to read t^ tables, Including a brief explana- 
tion of the way that median and quartlle percentile scores are derived, 
both for a national norm group and for a particular group of local 
students. 

3, An explanation of the various characteristics of each school, that 
are reported along with the test data. In order to define the context 
In which the test scores were made. Included are the number of stu- 
dents enrolled In the school, the percent attendance, the pupil/teacher 
ratio, the percentage of low-Income students, the ethnic distribution 
of the student body, and the major special programs operating In each 
school. 

The school summary test scores are presented In tabular form, separately 
for each grade within each Mhool, and separately for reading and math. 
Each table displays the median, first quartlle, and third quartlle scores 
for the school, grade, and test under consideration, for the past five 
school years. Similar tables are presented at the beginning of Volume I 
for the district summaries, separately for each elementary grade level and 
for reading and math. Scores for grades 1, 3, and 5 are only reported for 
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thv past three school years, because before 1975-76, the CAT was admini- 
stered in even-numbered grades only. 

The following pages display examples of a "School Characteristics Page", 
which serves as a cover page for the achievement tables for each school, 
and the actual tables displaying the summary CAT information for both 
reading and math. 
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ABSTRACT 

Title: Austin Independent School District School Campus Longitudinal 
Trends, 1973-7A through 1977-78, Vol. Ill: Junior High Schools 



Contact Pers on; Jane Ogden, Ph.D. 

T 

No» Pages: 59 



Summary : 

This volume Is a tabular and graphic record of the California Achievement 
Tests results In reading and math for each Junior high school In the Austin 
Independent School District for the past five years: 1973-7A through 1977- 
78. District summaries In reading and math, for the seventh and eighth 
grades, are also presented. A forevard at the beginning of the volume is 
divided Into three major sections: 



1. A discussion of the limitations of the achievement data, Including 
an explanation of which groups of studenta were exempted from the 
testing, a descrlptlon^f the testing situations, and the methods 
used for scoring the £ests. 

2. An explanation of how to read the tables, including a brief expla- ; 
nation of the way that median and quartlle percentile scores are 
deplved, both for a national norm group and for a particular group 

of local students. 

3. An- explanation of the various characteristics of each school that are 
reported along with the test data, in order to define the context in 
which the test scores were made. Included atre the number students 
enrolled in the school, the percent attendance, the pupil/teacher 
ratio, the percentage of low-Income students, the, ethnic disrribution 
of the student body, and the major special programs operating in ^ach 
school. 

The school summary test scores are presented in tabular form, separately 
for each grade within each school, and separately for reading and math. 
Each table displays the median, '"trst quartlle, and third quai-tile scores 
for the school, grade, and test under consideration, Cor the past five schoo 
years. Similar tables are presf \ted for the district summaries, separately 
for the seventh and eighth grades and for reading and math. 

Displayed In the following pages are examples of a "School Characteristics 
Page**, which serves as a cover page for the achievement tables for each 
school, and the actual tables displaying the Bummary CAT Information for 
both rending and math. 
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ABSTRACT 

Title ; Austin Independent School District School CampMs Longitudinal 
Trends, 1973- 74 through 1977-78, Vol. IV: Senior High Schools 

Contact Person ; Jane Ogden, Ph.D. i 



No. Pages ; 289 
Summary : 

This volume is a tabular and graphic record of the median and quartile 
scores on the Sequential Tests of Educational Progress for each senior 
high school In the Austin Independent School District. The STEP is a 
battery of achievement tests designed to measure student skills in the 
academic areas of Reading, English Expression, Mechanics of Writing/ 
Mathematics Computation and Concepts, Social Studies, and Science. Data 
are presented for the school years 1975-76 through 1977-78, for grades 
9-12. District summaries, in each skills area, for each high school - 
grade level, are also included. A foreward at the beginning of the vol-, 
ume is divided into three major sections; 

1. A discussion of the limitations of the achievement data. Including 
an explanation of which groups of students were exempted from the 
testing, a description of the testing situations, and the methods 
used for scoring the tests. 

2. An explanation of how to read the tables, including a brief explana- 
tion of the way that median and quartile percentile scores are derived 
both for a national norm group and a particular group of local stu- 
dents . 

» (' 

3. An explanation of the various characteristics of each school that are 
reported along with the test data, in order to define the context 

in which the test scores were made. Included are the number of stu- 
dents enrolled in the school, the percent attendance» the pupil/ 
teacher ratio, the percentage of lowincome students, the ethnic 
distribution of the student body, and the major special programs 
e^peratlng in each school. 

The school summary test scores are presented in tabular form, separately 
for each grade within each school, and separately for each skills test on 
the STEP. Each table displays the median, first quartile, and third quar- 
tile scores for the school, grade, and test under consideration, for the 
past three school years. Similar tables are presented for the district 
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summaries, separately for the ninth, tenth, eleventh, and twelfth grades, 
and for each skills test. 

Displayed in the following pages are examples of a "School Characteristic 
Page", which serves as a cover page for the achievement tables for each 
school, and the actual tables displaying the summary STEP information in 
two sample skills areas. 
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FINAL REPORT 



Evlijat to n Flndlnaa on ; Low SES and Minority Student Achievement Study 



Contact Person : Jim Watklns and Jane Odgen 
Sununarv of Evaluation Findings ; 

An examination of the dlffei^uces between the achievement levels of the 
different ethnic groups In 1977*1978 was done by looking at the medians 
for each ethnic group and the distribution of scores at both the elementary 
and secondary levels. 

California Achievement Test (CAT) results Indicate that there lb a substantial 
difference between the average achievement for Anglo and minority students. 
For Instance, Figure 1 shows the average achievement on the Math Total and 
Reading Total for each ethnic group for grades one through eight. 
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Figure 1; CAT READING TOTAL AND MATH TOTAL MEDIANS FOR EACH ETHNIC GROUP IN 
GRADES ONE THROUGH EIGHT. 

Further examination of the median percentile scores on the CAT by each 
ethnic group Indicates that: 

1) Anglo students at every grad^ level of grades one through eight 
had higher median scores, than minority students on every subtest. 

2) Modlan percentile ranh scores for Anglo students reflect the same 
downward trend that was apparent among minority students. However, 
Anglo student medians level off at about the fourth and fifth grades 
while minority student medians continue to decline. 

3) The gap between Anglo and minority student achievement becomes 
progressively wider from grades one through eight. 

4) The gap between the median scores for Anglo and minority students 
is smaller In Math Computation than in Math Concepts. 



^This study was partially funded by the National Institute of Education 
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* 

5) The patterns for reading and math are similar. However; the 
difference betyeen Blacks and Mexican-Americans tends to be 
smAller for reaciing. 

The range of CAT median scores for AXSI) Black students on the Reading 
Total was 667.il e in thu f^rst grade to 1 97.il e in the eighth grade. This 
means that the' average first grade Black student in AISD performed as 
well as a student nationwide that ws't 16%ile points, ab<^ve , the national 
norms of 50.' The vaverage eighth grad» Blapk student in AISD performed 
only a, well as a student nationwide t-hat was . 317.ile points below the 
national norm uf 50. The ran^e of median scores for AISD Mexican-Anerican 
students was 627.ile in the first grade to,22%ile in the sixth grade. 
For Anglos the*" range was 83%ile in the first grade to 667.ile in the sixth 
grade. . 

The distribution of scores was also indicative of the increasing difference 
between minority an^i Anglo students as they progress through fchool. The 
percentage of minority students in AISD who Score in certain ranges of 
the percentile rank on the Reading and Math Totals is presented in Figure 2. 
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Fi^Mte 2: PERCENTAGE OF^TUDENTS BY ETHNICITY IN GRADES ONE THROUGH EIGHT 
SCORING IN VARldUS PERCENTILE RANGES ON THE CAT MATH AND READING 
TOTALS, SPRING, 1978. 
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These figures indicate that at each grade level for grades one through 
eighth there are progressively more minority students scoring in the lover 
percentile ranges and fever minority students scoring in the upper percentil 
ranges in both reading and math; By the eighth grade, approximately 807. 
of AISD*s minority students score in the lover fifty percentile ranks, and 
approximately 20% score in the upper fifty percentile rank. 

Longitudinal data from the past three years indicates that minority student 
medians at each grade level in 1977-1978 vera generally higher than those 
of previous years for the same grades. The strongest gains in minority 
student medians over the past three years have been made at grades one 
through three. The veakest gains yevc made in grades six through eight. 
Figure 3 presents the median for each ethnic group at each grade level 
for the past three years. 
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Figure 3: MEDIAN CAT SCORES FOR READING TOTAL AND MATJJ TOTAL FOR EACH 
ETHNIC GROUP AT FJVCH GRADE LEVEL FOR 1975-1976, 1976-1977, 
AND 1977-1978. 



An exaniiuatUni of the differences In achievement between Title I school 
and noa-Tltle I school students revealed several major points: 

1) Non-Title I Mexican-American students achievement exceeded 
Title I school Mexican-American achievement' in both CAT Reading 
and Math acrosn grades one through five, 

2) Non-Title I school Black student achievment exceeded Title I 
school Black achievement in both CAT Reading and Math across 
grades one through five, with very few exceptions. 



3) Whllt non-Tltlt I school stiidtnt achltvtment typically axcaads 

Tltta I school achltvMitnt whan considtring Blacks » this diffaranctp 
at tha madlan raftranca pointy is quita small across all flva 
gradas survayad. Tha small slza. of this dlffaranca Is conslstant 
for both raadlng and math achlavamant, 

A) Mtxlcan-Amarlcan studant achiavamant in Tltla X and aon-Tltla I 
schools is similar to tha pattarn of achiavamant for Black 
studants in tha two typas of schools, Howavar» tha diffaranca 
batvaan tha two achiavamant lavals is substantially laigar than 
tha diflaranca notad for Black studants. 

ThuSp non-Tit la I school minority studant achiavamant axcaads Tltla I 
school minority studant achiavamant^ as maasurad by tha 1978 CAT Raadlng 
Total and Math total. Tha significanca of this diffaranca cannot ba complataly 
assessed however, because one of the strongest factors in achievement Is socio- 
economic status, which is what the Title I schools are aelected for. 

A comparison of the achievement medians of studenta at each grade in 
1977-1978 with the achievement medians for the 'same students in earlier 
grades (tracking group analysis) revealed several major points: 

1) Black student medians experienced by far the largest decline in 
the primary grades on both the Reading Total and tha Math Total. 

2) Black student medians declined more from first to eighth grade 
than any other ethnic group, 

3) The strongest Improvement in median percentile scoras was shown 
by the Mexican -American students in^ grades one through eight on 
the Reading Total. 

A) Overalt, tha tracking group students, both minority and Anglo, 
tended to loose slightly less than expected, baaed on the 
longitudinal data, at the primary grade levels and gain slightly 
more than expected at tha fourth through eighth grade levels 
on the Reading Total. 

3) Math Total medians for the tracking groups declined approximately 
as much as might ba expected when looking at longitudinal data. 

6) Tha decline in Reading Total Diadlana was greater than for Math 
Total medians. 

Based on longitudinal data, tha Mexican-American student medf.ans ware 
expected to decline at each grade from the first to the fifth grade. 
However, the actual tracking group medians begin to show increases in the 
fourth grade and cpntinue to do so through the eighth grade. 

Figure A presents the tracking group medians for each year. The change 
or difference in the scores of the students from one year to the next 
is presented in the next column. Finally, tha expected difference was 
based on tue longitudinal data.( For example, the expected difference 
for Black first graders of 1977 that became second graders in 1978 was 
the 1978 second grade median subtracted from the first grade, 1977 median. 
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Figure 4: TWO YEAR TRACKING GROUP MEDIANS BY GRADE AND ETHNICITY. The 

change In the scores of the students from one y^ar to the next 
is presented In the "change" column. The "expected change" 
column presents an extlmatlon of the change that normally 
occurs when going from one grade, to the next based on 
longltudlanl data. For example, the expected change for first 
grade Black students that became second graders in 1978 was the 
1978 second grade median for Black students subtracted from 
the first grade 1977 median. 



Sequential Tests of Educatioa Progress (STEP) results indicate that there 
is a subistantial difference between the average achievement for Anglo and 
minority students. Anglo students consistently had medians that were 
higher than those of minority students in 1977-1978 on all skills subtests 
at all grade levels. Mexican-American students had higher medians than 
the Black students. The district median falls roughly half-way between 
the Anglo and Mexican-American medians. Figures 5 and 6 present a graphic 
display of this pattern as illuBtrated by the Reading and Math Computation 
subtests. 
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STEP MEDIANS BY ETHNICITY 
FOR 9TH, lOTH, UTH AND 
12TH GRADES, SPRING, 1978. 
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Although Anglo studants consistantly 
•corad higher than minority students 
on the STEP over the past tvo yMrs, 
there was no distinct pattern of 
gains and losses that was consistent 
across all years, for all grades of 
each ethnic group. For soipe grades 
Anglo student scores Inprove .' from, 
the previous year while minority 
scores dropped; and for other grades 
the opposite was true. 

In 1977-1978 mifdlan Black scores 
showed mixed decreases and Increases 
on the STEP subtests from 1975-1976 
arvd 1976-1977. 

Mexican-American students showed 
little overall change in 1977- 
1978 Irom previous years. 

Anglo student medians in 1977-1976 
showed mixed Increases and dacfeases 
on the STEP subtests since 1975- ' 
1976 and 1976-1977. 

The weakest performance was at the 
twelfth grade level. Both Black 
and Anglo students medians dropped 
on all subtests. Mexican-American 
medians showed mixed gains and losses 
at the twelfth grade level. 

Figure 7 on the following page 
presents the median percentile 
scores for each grade and each 

ethnic group. 

The median percentile score for 
Black and Mexican-American students 
was compared with the national norms. 
The median percentile score for the 
national standardisation sample for 
all grades is 50. The extent to 
which median scores for minority 
students fall below the 50th XiU 
is the extent to which minority 
students in AI8D are lower than the 
national norms. AI8D achievement 
median data revealed that) 



Figure 6: STEP MEDIANS BY ETHNICITY 
FOR 9TH, lOTH, IITH AND 
12TH GRADES, SPRING, 1978. 
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Figure 7: MEDIAN PERCENtlLE SCORES FOR EACH GRADE AND EACH ETHNIC GROUP 
Qfi THE STEP OVER THE LAST THRfiE YEARS. 



1) tht mtdian icorei for both Black and Mexlc«n*Aflierlc«n high 
•chool itudtnti art far below tht median acorea of the national 
norming lample. ^ 

2) Mexican^American itudenti are typically cloier to the national 
normi than are Black itudenti* 

3) the Engliih Expreeiion ikiUi lubteit ii the veakeit area for 
Black and Mexican-^American itudenti at all high ichool grade 
leveli. 

4) Areai of relative itrength for minority itudenti are Math 
Computation^ Math Concepti and Spelling* 

Figure 8 on the following page preienti a graphic diaplay of the mediana 
of the twelfth grade itudenti with a reference line for the national norma* 
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Figure 8: 1977-1978 MEDIAN PERCENilLES FOR 12TH GRADE STUDENTS, BY 

ETHNICITY. The national norm of 50 li lined ai a reference 
point. 



Tracking group data on the STEP makei poiilble a conparlion of minority 
■tudent achievement at each grade In 1977-1978 wlthlllnorlty itudent 
achievement for the lame itudenti In prevloui yean at earlier grade 
level! . The ;two year tracking group medlani for itudenti taking the STEP 
In 1976-1977 and 1977-1978 ihow mixed galni and loiiei for all ethnic 
groupi at all grade leveli. Specifically, Black tenth g^ade itudenti 
ihowed tow galni and leven loiiei; eleventh grade, three gain, five loiiei, 
one no change, and twelfth grade, one gain, leven loiiei, and one no change. 
VHien the overall achievement pattern acroii gradef li conildered, Black 
Itudenti who took the STEP In both 1977-1978 and 1976-1977 had lower icorei 
In 1977-1978 than In the prevloui year. 

Mexican-American tenth grade itudent medlani iho%Md five galni, two loiiei, 
and two no changei. The eleventh grade ihowed leven gain';, one losi, one 
no change and the twelfth grade one gain, eight loiiei. When the overall 
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Achl«v6m«nt pattern across grades is considered, Mexlcan*Amerlcan students 
who took the STEP In both 1977-1978 and 1976-1977 had higher scores In 
1977-1978 than in the previous year. 

Thus, the students in the Black two year tracking group made lower 
achievement scores on the majority of the skills tests in the Spring of 
1978 than they did In the previous year. The students In the Mexican- 
American tracking group had slightly higher achievement scores on the 
skills tests for Spring 1978. 

The students In the Anglo two year tracking groups had a more or less 
equal number of gains and losses on the skills tests from Spring, 1977 to 
Spring, 1978. Comparison of the tliree ethnic group achievement patterns 
reveals the following patterns: 

1) all three ethnic groups show the largest number of losses in 
the twelfth grade. 

2) Black students show fairly, consistent losses across all three 
' grades. ^ 

3) Mekican-American and Anglo tracking group students had more or 
less equal numbers of gains and losses on the skills tests. 



Figure 9 presents a graphic summary of the tracking group data on the 
Reading subtest of the STEP. 
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Figure 9: MEDIAN PERCENTILE SCORES BY GRADE AND ETHNICITY FOR THE 
TWO YEAR TRACKING GROUP STEP ACHIEVEMENT DATA. 
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Scholaitl c Aptitude Test (SAT) scores have been coneiitently higher than 
the national mean tcoret. ^However, lince 1971-1972 there continue! to 
be a decline in both the Verbal and Math scoree acrosf the nation and in 
AISD. The rate of decline of AISD Verbal fcorei parallel! the decline of 
the national icoree. However, in Math, the AISD acoree, altho'.gh declining 
flre not going down as sharply as those across the nation. Although SAT 
data is not reported by ethnicity, the percentage of minority students 
taking the SAT is reported. An examination of the percentage of participatio 
by minority studehts revealed three major points: 

^ 1) the percentage of Anglo students in 1976-1977 who took the SAT 
(about A47.) was about double the percentage of minority students 
who participated. 

2) a slightly higher percentage of Mexican-American students (about 
207o) took the SAT in 1976-1977 than did Black students (about 17%). 

3) approximately 227. of the minority (non-Anglo) students who were 
seniors in 1976-1977 took the SAT. 

e 

The data for minority participation in the SAT is presented Figure 10. 
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Figure 10: TRENDS IN PERCENTAGE OF PARTICIPATION IN SAT FOR MINORITY 
STUDENTS. Reported percentages of each group are computed 
as (i^ of SAT-takers) (f^ of students enrolled n Oct. 1st) • 
Percentages should be considered as approximate. 



In addition to the 1976-1977 data on minority participation, there was 
also data on the pet'centage of minority students taking the SAT for the 
previous three years. The trend over the past four years has been one 
of increasing minority participation. The trend is essentially the same 
for both Black and Mexican-American students. 
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The American ColleRe Test (ACT) results in 1976-1977 shox^ both AISD and 
nationwide oaans below the norming sample mean of 20. In addition, this 
yearns AISD scores were slightly lower than the nationvide sample for 
English, Social Studies an^l the Composite score ahd subatant .^lly below 
for the Natural Science. Although ACT does not report resu4.t8 by 
ethnicity, the percentage of minority student participation is reported. 
An examination of the percentage of participation by minority students 
revealed several major points; 

1) Black student participation has not changed noticeably since 
1969-1970. 

2) Mexican -American participation has more than doubled since 
1969-1970. 

3) Total minority student participation has doubled since 
1969-1970. 

4) Anglo paricipation has decreased by approximately 20% since 
1969-1970. 

5) There appears to be a strong correlat^'^'^ between decreasing 
ACT scores ,and increasing minority pan cipation. 



Figure 11 presents the ethnic breakdown of AISD ACT-takers. 
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Figure 11: ETHNIC BREAKDOWN OF AISD ACT-TAKING SAMPLES SINCE 1969-1970. 



School Leaver Data 

School leavers are students who withdraw from AISD schools before 
graduation and do not go to other schools. Leavers also include students 
who stop coming to school without officially withdrawing. 

In 1976-1977, 3.30% of the Black students, 3.75% of the Mexican-American 
students and 2.38% of the Anglo students at all grade levels were school 
leavers. The distriltwide percentage of leavers was 2.87%. Once again 
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the tame pattern across ethnic Ityles Is evident- -Aaglo school leavers 

number slightly lower than the district average while minority school leavers 

number slightly higher than the district average. 

Most of the students who leave are at the high school level. In 1976-1977, 
11.147. of the Black students, 13.97. of the Mexican-American students, and 
6.157, of the Anglo students at the high school level were school letvers. 

Figure 12 shows the percentages of each ethnic group who were school 
leavers at all grade levels over a five year period. 




SCHOOL YEARS 

Figure 12: THE PERCENTAGE OF EACH ETHNIC GROUP WHO WERE SCHOOL LEAVERS AT 
ALL GRADE LEVELS OVER A FIVE YEAR PERIOD. 

DJjtrlct Budget Sunmary 

A total of fourteen special programs were Identified as operating In the 
twenty-five Title I schools during the, 1977-1978 school year. Most of these 
were carried over from the previous year. Funds totaling three million 
dollars were expended on these programs, with 347. going to the Title I 
program and 257. to the meal program. The remaining funds were distributed 
more evenly. Generally, funding levels have increased over the past, but 
mu( h of the Increase can be attributed to pay Increases for district 
personnel. 



Figure 13 presents the funding levels for six major programs for two years. 
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Sunwiary 

Tht general pattern in AISD of achievement related data it that Anglo 
student! will typically score better than the diptrictvide average, 
Mexican-American students worse than the districtvide average, and Black 
students slightly below the Mexican-American students. 

AISD achievement medians on the CAT^ in 1977-1978 in grades one through 
eight were the highest since 1975-1976 on virtually all subtests at 
all grade levels. The ethnicity achievement data indicate that: 

1) Anglo medians were substantially above both minority groups. 

2) All ethnic groups reflect the same downward trend in the 
primary grades. However, the Anglo medians level off around 
the fourth grade and minority student medians continues to drop. 

* 

3) Ihe gap between minority students becomes progressively wider at 
higher gr^de levels. 

A) Although the extent to which socio-economic status effects the 
level of achievement cannot be determined, non-Title I minority 
student achievement exceed Title I minority students achievement 
at grades one through five. For Blacks, the difference between 
achievement at the two types of schools was small, but for 
Mexican-Americans, the gap was substantially higher, 

5) Trackihg group studies indicate that minority students are doing 
better than might be expected if Just the longitudinal data were 
analyzed. ' 

The AISD achievement medians on the step in 1977-1978 in grades nine 
through twelve showed mixed gains and losses. The ethnicity achievement 
data indicate that: 

1) Although Anglo students consistently scores higher than 
minority students over the past two year, there was no 
distinct pattern of gains and losses that was consistent 
across all years, for all grades. For some grades Anglo 
student scores improved from the previous year while minority 
scores dropped; and for other grades the opposite was true, 

2) The weakest performance was at the twelfth grade level, with 
Black and Anglo medians dropping on all subtests and Mexican- 
American medians showing mixed gains and losses. 

3) The median scores for minority students are far below the median 
scores of the national norming sample. 

4) The two year tracking group medians for students taking the STEP 
In 1976-1977 and 1977-1978 showed mixed gains and losses for all 
ethnic groups at all grade levels. 
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The scores on the college admission testa, the American College Test (ACT) 
and Che Scholastic Aptitude Test (SAT), continued to decline in 1976-1977. 
The rate of decline parallels the decline in national /scores. In addition, 
the trend for both the 5AT and the ACT over the last .ir years has been 
one of increasing minoritfy student participation, 
-.1 

Di rictvide graduation rates in 1977-1978 were up from the previous year. 
In addition, the individual graduation rates for each ethnic group were 
also up over the previous year. For the period for which ethnicity data 
Is available, Anglo graduation rates were the highest and showed the least 
amount of fluctuation. Minority student graduation rates have fluctuated 
over the past eight years with no specific trend being evident. 

School leaver data indicates that most of the students who leave are at 
the high school level. In 1976-1977, 11.4% of the Black students, 13.9% of 
the Mexican-American students-, and 6.137 of the Anglo students' at the 
high school level were school leavers. 

A total of fourteen special programs were identified as operating 
in the twenty- five Title I schools during the 1977-1978 school year. 
Funds totaling three million dollars Were expended on these programs, with 
34% going toUhe Title I ptogram and 2S7o t6 the meal program. The 
remaining funds were distributed evenly among the^ remaining programs. 
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S u—ary t 

Educational riaaarch auggasta that the Involvamant of paranta of low 
locio-aco. omlc statua (SES) children In tha educational procaaa haa a 
poaltlva Influence on the children's academic achlevenent. 

At the preechool level, studies In which parenta were Inatiuctad con- 
cerning methoda of promoting their cKlldran'a Intellectual devalopment 
were found to be particularly succeaaful In producing long-tern 
improvementa In the academic achievement of low SES children. A few 
atudleff alao report succeaa In Improving the achievement of low SES 
children whoae parenta work as paraprofeaalonala In the school, or 
aerve In an advlaory capacity for preschool progrema. 

At the elementary level, the limited reaaorch which la avAilable In- 

dlcatea that parents who serve aa tutora for their children can 

improve their children's academic achievement. 

More reoeavch on methoda of improving academic achievement through 
parent i^-volvement programs is still needed, but th4,reaMrch tbua tar 

haa generally ahown that such programa do have a poaitlyraffect on 
academic achievement. ~> 
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The •voluAtlon dtaign is a one-year 
projtct. The table of contents for 

I. Evaluation Design Review Fom 



II. Dec la ion Questions 

III. Narrative Sununary 
IV. Infonuatlon Sources Summary 

V. Sumnary of Data to be 
Collected 

VI. Evaluation Time Resources 
Allocation Summary 



plan of evaluation work for the 
this document Includes: 

This form presents the names of persons 
who are responsible for some aspect of 

the project's implementlon and vho 
have been provided with relevant 
portlOiU of the design for review and 
comment. 

In thla aection, all of the decision 
questlona are stated and are related 
to the relevant evaluation queationa. 

Thla aectlon briefly deacribea the 
project and the evaluation activitiea. 

The apeclflc analyala ptocedurea for 
each of the evaluation queationa are 
preaented in thla aectlon. 

Thla aectlon containa a timeline for 
the data collection activitiea 

Thla aectlon aummarisea all of the 
evaluation work eatimatea (in peraon- 
daya) y poaltlon, fur each aapect of 
the evaluation. 



Thla dealgn repreaenrs the evaluation plana for the aecond of a two year 
examinaeion of low SES and minority atudenta in the diatrict. The 
evaluation la latende^to ftovide^ information to diatrict decisionmakers 
concerning the adopte^blatnct priority of Increaaed attention to the 
low SES and minority atudenta in Auatln'a achoola. 

TK^ evaluation dealgn conalat9 of obtaining information concerning three 
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different areas of emphaali: 

. Detalltd Analyaen by ethnicity of icveral typet o£ student ptrform' 
nnce, including achlevoacnt, attendence, drop-out ratea and 
graduation ratea. Tht purpoaa of theaa analyaea ia to provida 
a complete picture of thtat atudtnta. Parfomanca data of thii 
type was collected for aarlier yeara duriug the flrat yaar'a 
evaluation. Conaaquently, trenda can ba examined in addition 
to deacribing tha aituation as of the current school year. 

. A continuation of the collection of data regarding the level of 
funding support for low SES and minority students will be made. 

. An investigation of the type of teaching strategies that are 
utilized by teachers o£ low SES students will also be provided. 

Scope of Design ; 

2 Decision Question Questions 
17 Evaluation Questions 

Evaluation Resourcei Required (In oerBon-dave^ 

7 Director 

17 Senior Evaluator 

50 Evaluator 

20 Data Analyst 

25 Evaluation Assistant 

15 Secretary 
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(Final Raport) 



Evaluation Findings On ; ProfaaalQnal Paraonnal Evaluation Syatam 



Contact Peraona ; Catherine A. Chrlatner, Ph.D. and Freda Holley, PhtD. 

Suaimarv of Evaluation Findings : 
Introduction 

The AISD Board of Trustees set as one of their major goals for tha IQ??- 
1978 school year, the revision of the evaluation system for professional 
personnel. Previous to this decision, the Board had appointed a committee 
composed of teachers and principals to revise the current evaluation 
system. Although the committee had gathered a great deal of Input, the 
Board did not adopt the proposed system due to legal problems relating 
to vaguenesfl of criteria and the time demand problems for evaluators. 

The Board turned the question of the development of a new evaluation system 
ov^r to Its Personnel Committee. This conmlttee directed the Office of 
Stj^ff Personnel, the Office of Research and Evaluation and the school 
at<:orney to. develop a system that solved the problems of the commlttee- 
de'/eloped system. The Board required thac the new system be completed 
for their perusal by December 1, 1977. 

The evaluation design for this system for 1977-1978, called for two different 
types of activities on ore's part. The first and most major activity was 
to provide technical support for the Office of Staff Personnel in the 
development of the new professional personnel evaluation system. The second 
type of activity was the collection of baseline data for the purpose of 
evaluation of the new system. Both these types of activities will be 
discussed under the relevant decision question. 

Decision Question 1. WHAT COMPETENCIES SHOULD BE COVERED IN THE AISD 

PROFESSIONAL PERSONNEL EVALUATION FORMS? 

The first step In the revision process was to base the evaluation instru- 
ments on a set of competencies that were as specific and behaviorally 
stated as possible. The cattgorles of competencies developed by the 
earlier appointed cothmlttee were taken as the starting point since so 
much district input had led to their selection. Based on these categories, 
the available literature was surveyed and an initial list of 90 highly 
promising cc^mpk^encies was selected. 

In order to maximise consensus within the district on which competencies 
were seen as important, all the professional personnel (including admin- 
istrators were surveyed as to how they rated the Importance of each 
competency. Every teacher, librarian, counselor, special education, teacher 
and principal received a random sample of items to miniuite time spent 
on the task. In addition, a sample of parents and high school students, 
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Unlvarilty of Taxaa education profeiiori and cantral off lea admlnlatratora 
(a*g. the coordlnatora and bilingual Inatructlonal apaclallata) alao 
ratad tha laportanca of the Itama. 

Analyaaa of tha reaulta of tha aurvey allowed for tha conaenaual aelectlon 
of tbe final Iteipaefor each of the four profeaalonal evaluation Inatruaenta 
(teacher, apeclal education teacher, librarian and counaelor). Figure 1 
contalna the 63 teacher competenclea choaen through th la dlatrictylde 
aurvey. Coplea of all the evaluation Inatrumenta to be uaacUfor the 1978- 
1979 yenr are In the Profeaalonal Peraonnel Evaluation Handbook. 

Decision Question 2: WHAT SHOULD AISD INCLUDE IN THE PROFESSIONAL PERSONNEL 

EVALUATION HANDBOOKS AS A BACKUP FOR THE COMPETENCY 
EVALUATION INSTRUMENTS? 

In the fall of 1977, the secondary prlnclpala and fifty percent of the 
elementary principals were Interviewed about their concema with the current 
evaluation system as well aa their Idea of an Ideal evaluation ayatem. A 
aaraple of teachera was randomly aelected from these schools and aurveyed 
regarding these Issues. . 

Both groups agreed that arr Ideal system should be systematic, ongoing and 
have periodic steps. Each group felt a pra-appralaal conference was da- 
alrable. A strong need for a variety of documentary forma waa felt by 
both groupa, since It was agreed that Inadequate performance must be doc- 
umented before Incompetent teachers could be terminated. Alao the reapondenta 
Indicated that Ideally^ an evaluation ayatem ahould Include obaervatlona of 
teachera and data from a variety of clrcumatancas should be Included. Ideally, 
too, the evaluation proceaa ahould coanit the dlatrlct to deal with personnel 
development. Many of the procedurea and the documentation Identified aa 
necessary In an Ideal system were perceived ae currently Inadequate by the 
teacher reapondenta. Thla trend was alao found In the principals* reaponaea, 
although It waa not as strong. 

The New Teacher Checklist data for the fall of 1977 were analysed to 
examine the current ratlnga being given. Thla Information proved valuable 
In giving direction In some needed backupa for tl\e new ayatem. The check- 
list waa completed differently by different", evaluators - some checking 
only the main category headlnga, aome ualng aubheadlngs only and othera 
ualng a combination. This suggests the need for atandardlsed procedures 
for the completion of evaluation forma. The ratlnga given were greatly 
Inflated over what would be expected from the normal curve. More apeclflc 
definition of the acale points as well as behavioral cxamplea for each 
competency could help make the baals for evaluation more consistent across 
evaluators. 

The Professional Pers<*nnel Evaluation Handbook developed by the Office of 
Staff Personnel with the technical assistance of the Office of Research 
and Evaluation addresses many of the concerns expressed in the survey of 
teachers and principals. The introduction explain^ the basis for and contains 
the data upon which the competency - baaed evaluation instrumenta were 
developed. The policies of the district governing contract regulations are 
clearly laid out. The required procedures are specified in detail. 
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THE SIXTY-THREE TBACHCR CONPBTENCirS 



Two observations (three for new professionals) are required before evaluation 
occurs* The recommended procedures encourage pre-appralsal conferences and 
a competency Improvement plan for working with professionals to Improve the 
Instructional program. An extensive section on behavioral descriptors for 
each competency is included to aid both the evaluator and the evaluatee in 
focusing on what behaviors to look for in each competency area. Also in 
this section^ focus is given to a variety of possible data source^ for 
gathering information abou" a professional's performance. Extensive district 
resources are detailed liv a ectlon dealing with improving evaluatee per- 
formance. The next part oft ^ Handbook details vhat determines contractual dif- 
ficulty and recommended steps (in addition to those in the Improviitg 
Evaluatee Performance section) for working with these professionals. Resources 
are uhen given to aid evaluators develop their skills. In addition to this 
evaluator training sessions have b^en (and will continue to be) conducted to 
train evaluators to assure consistent use of the evaluation instruments as well 
as help standardize the evaluation process districtwide. Finally the appendices 
in the Handbook conMln a variety of observation formr, and parent and student 
input forms for possible (but not required) use. 

Decision Question 3: WHAT TRAINING SHOULD AISD PROVIDE FOR ADMINISTRATORS 

WHO WILL EVALUATE PROFESSIONAL STAFF? 

When the principals and the teacher sample were surveyed in ^he fall of 1977 
about the current and ideal evaluation system they also received a questionnaire 
about evaluator training. Teachers generally felt that evaluators needed more 
training than the evaluators themselves did. The figure below shows the 
responses of principals and teachers to some areas of possible training needs. 
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FlKure 2: PRINCIPALS AND TEACHERS RESPONSES TO EVALUATOR TRAINING NEEDS 



The two most Important concerns for both groups were using available resources 
to facilitate the further development of all teachers and the use of conferencing 
skills which assure better feedback as well as planning and problem solving. 
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In November the staff of the Office of Staff Personnel, the O.R.E District 
Priorities staff and U.T. R&D staff nembers met and bralnstomed possible 
evaluator training needs should the new system (In development) be approved 
by the school Uoard. The first need was determined to be Initial orientation 
to the system - including make-up of the system, how It was developed, 
thA system philosophy, and how to present the system to t»>e faculty. It 
was felt that a major part of the proposed system should be a comprehensive 
staff development plan for evaluators both to learn the system and Improve 
such skills areas as data gathering, written documentation and conferencing. 

The December 14, 1977, Issue of Update presented a brief summary of the 
proposed system. This was seen as an Initial Introduction for all district 
personnel to the system. 

On January 9, 1978, the Board approved the new evaluation system and a 
calendar of training for evaluators. This wad to Include in-depth orientation 
sessions for principals and other evaluation team members (including the 
coordinators, assistant principals, etc.) in March of 1978. In the summer 
and continuing through the 1978-79 school year, additional training was to 
be conducted in the skill areas of data gathering, written documentation and 
conferencing skills. 

The January 11, 1978, principals' meeting was devoted to the new evaluation 
system. The new evaluation Instruments were presented as the data upon 

which they were based. The required and recommended procedures were discussed 
as well as, dealing with professionals in contractual difficulty. 

The major orientations to the new system were held in group meetlnjgs in 
March and April of 1978. The special education supervisors (due to scheduling 
problems) received individual training earlier. Although the sessions were 
broken into elementary, secondary and special groups (i.e. Developmental 
Programs, Office of Student Development, etc.) the ^tent was basically 
the same. A video tape of Dr. Davldcon and other dlwrlct representatives 
was used to present the philosophy of the new system, some positive aspects 
as well as some concerns of teachers and principals.' Differences and 
sirailarities between the old and the new system were detailed. The system 
was then explained in more depth by going through the Handbook and focusing 
upon required and recommended procedures. In the secondary sessions, in- 
structional coordinators discussed their role in the evaluation team. 
Brainstorming was conducted to generate ideas on how the new system could 
be used to help improve instruction. The gro jps also discussed their future 
training needs. 

The last part of the orientation was an assessment conducted by ORE to de- 
termine the evaluators' knowledge of the Handbook, their attitudes about 
the training session as well as their needs for further training and a 
preassessment of possible training needs in various evaluator skill areas. 
Some areas of need for further training that were indicated by this assess- 
ment were: Additional stress on primary and secondary Information sources; 
study of a wider variety of good data sources on a professional's perfor- 
mance; more in-depth work on the aspects of good observations and conferencing 
skills; what makes up a good lesson plan; use of the actual ivaluation 
instruments; and clarification of how to work most efficiently as part of an 
evaluation team. 
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The attltudei toward the March and April workshopa ware quite pcltlve with 
moat reapondenta feeling the training had not only oriented then to the 
new ayaten, but had made them more poaltlve about the ayatem and more 
knowledgeable about where to go for help or queatlona dealing with the new 
ayatem. Both verbally In the group aeaalona and through written feedback 
at the aeaalona, the workahop partlclpanta expreaaed their needa for further 
training. Theae are preaented below. 
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Figure 3: MAJOR TRAINING NEEDS EXPRESSED BY EVALUATORS 



As can be noted there was considerable agreement between elementary and 
secondary evaluators and evaluation team members about their needs* Since 
they received their Handbooks In the March and April sesslonf, the aspect 
of reading and studying the Handbook will be covered* Additional training 
is being planned for the summer In observation (using video tapes and case 
studies) written documentation! use of the evaluation forms and conferencing. 
As part of the Boards directive that O.R.E evaluate the training, additional 
training activities will be monitored and evaluated to give feedback to 
the Office of Staff Personnel. 
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Decision Question 4. WHAT REVISIONS SHOULD BE MADE IN THE SYSTEM WHICH WILL 

BE IMPLEMENTED IN 1978-1979? 

The evaluation questions for this decision question focused on two aspects 
of the current system: The ratings given to professional personnel under 
the present system and attitudes toward the current evaluation system. . 

The data from the spring, 1978, pilof esslonal evaluations wre not ready to be 
analyzed In time for this report, however the New Teacher Checklists completed 
In the fall of 1977 were analyied. All data on Individuals were kept strictly 
confidential. 

The table below presents the percentages of excellent and satisfactory ratings 
given to new district professionals. The special groups category Includes 
such professionals as school psychologists. Title I reading specialists, etc. 



1 

ff it— twill 


l| 

il 


1 

t 

1 


J 

V 


\ 

mm 

1 


jl 


1 

i\ 

ii 


-J 

s 


i 

• 

J 

1 


! 

11 
II 


3 

1 


If 


z 

1 

U 

Ii 




100 


il.4 




ii.k 


UT 


loi 


5«.i 


*o.» 


30.i 


2i.o 


23.7 


40.9 




M.7 


M.9 


M.4 


H.3 


•7.S 


»7.J 


3f.« 


23.3 


ao 


t3.« 


19.2 


:o.i 


Sf. Ii. 


100 


HA 


M.a 


100 


M.O 


M.O 


45.1 


35.3 


32.0 


27.S 


22.4 


49.1 




100 


M.7 


100 


109 


too 


100 


M.7 


20.0 


14.3 


3S.7 


3S.7 


21.7 




100 


100 


100 


100 


too 


too 


7t.4 


•1.3 


13.3 


U.4 


*d.O 


90.0 




•f tit 






MM U 










M Of 


iMaXlMC Ui 





Figure 4: PERCENTAGES OF SATISFACTORY AND EXCELLENT RATINGS 
ON THE NEW TEACHER CHECKLIST 



As the abore fi^urt illustrates, ratings given were quite positiv*. 
The ratings on the categories that refer more to personal characteristics 
(i.e. Personal Qualities, Human Relations and Attitude toward Supervision) 
were more highly rated than those which refer to teaching or planning 
behaviors. Comparisons of the ratings given elementary and secondary teachers 
indicate generally across the six categories, new elementary teachers received 
higher ratings than did new secondary teachers. This was somewhat true 
of the comparisons between elementary and secondary special education 
teachers as well. As discussed in Decision Question 2, evaluators differed 
a great deal In their techniques of scale completion. 

The analyses of the New Teacher Checklist data strongly suggests the 
need for systematltatlon of completion of the evaluation forms as well 



as rating scale gul es to Judge how to rate evaluatees on each competency. 
The Increase of the rating scale to five points coul4 Increase the "spread" 
of the ratings perhaps more accurately reflecting the population evaluated. 

Comparisons were made between the ratings of the checklist portion of the forme 
and the comments section. The ratings were somewhat related to the cements, 
in the sense that a high rating was usually accompanied by positive connents. 
However, the comments were generally not related to the specific rating cate- 
gories In any dlscernable way. This suggests that evaluatora need to be 
trained to give more useful (to the evaluatee) comments based upon the areas 
evaluated. The new evaluation forms ( and the training In the new system) 
will hopefully Improve this situation since evaluators are asked In the com- 
ments section to Justify as much as possible higher or lower(than the "3" 
level) ratings and speak specifically to the evaluatee 's strengths and areas 
in need of improvement. 

The principals interviewed and the teachers surveyed in the fall survey on 
attitudes toward the current and an ideal evaluation system responded to a 
question about their major concerns about the currentl/(1977-78) used evalua- 
tion system. The figure below presents the tabulation of these concerns. 
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Bvaluatora do not hava anoygh tlM to ob- 
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Evaluation form und critaria too ianaral. 


27 
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Procasa and ayata« not npaitad out and aya* 
ttaatic* 


7 
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Objactivity in thia ayata« hard* 
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Figure 5: RESPONDENTS' CONCERNS WITH THE PRESENT EVALUATION SYSTEM 

% 

As can be noted, most of these concerns have been addressed In the new system: 
It Is more systematic, more behavioral imor^ specific and more objective; the 
Hatidbook spells out details of the system; working with helping professionals 
Is stressed; observations are required; and feedback to the evaluatee Is one 
tocus In the evaluation process. Unfortunately, the time problem Is a major 
concern of both evaluators and evaluatees and the new system does not solve It 
per se. It does however, spell out what both parties can expect In the 
process, therefore allowing for more planning and hopefully better time > 
management of the evaluation process. 

As part of baseline data gathering, 1977 AISD graduates were surveyed 

about their feelings about their school experiences. This year these 

former students were asked to judge the competence of the teachers they 

had. Three-fourths agreed or strongly agreed that AISD teachers are competent. 
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Despite majority agreement » there may be aome cause for concern whan 18 to 
31% of the graduatea disagree that teachers possessed such competencies as 
"Used common sense In Instruction." Hopefully the new evaluation aystem, 
in making the Improvement of instruction its major priority, will Increase 
the numbers of students satisfied with their teachers. 





Graduates' Responses 


Teachers 


Agreed •¥ 


Disagreed + 




Strongly Agreed 


Strongly Disagreed 


Had knowledge and broad subject 


82Z 


18X 


area backgrounds. 




21X 


Presented material verbally in clear 


79% 


manner . 




24X 


Used common sense in Instruction. 


76Z 


Respected my rights & encouraged res- 


74X 


26X 


ponsibility. ^' 




31Z 


Could tell if students had learning 


69X 


problems . 







Figure 6: GRADUATES' RESPONSES TO STATEMENTS THAT TEACHERS HAVE THE LISTED 
COMPETENCIES . 
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This is a timeline for the collection of 
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This chapter suamarizas all the evaluation 
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t^valuation Da a i^n Smmary : 

In tht tuQiiiar of 1977, the Board rejected a committee-developed teacher 
evaluation proceaa due to vagueneaa of criteria, tlme-demand probleaa for 
evaluatpre and other legal problems. The Board referred the revisions of the 
process to Its ovn Personnel Committee, who In turn directed the Office of 
Staff Personnel, the Office of Research and Evaluation and the school attorney 
to develop a system that solved the problems of the committee-developed system. 
Ihe Board required that the new system be completed for their perusal by Decem- 
ber 1, i977. 

The evaluation for this program calls for two types of activities on ORE's 
part. The first will be technical support for the Office of Staff Personnel 
in the development of the new professional personnel evaluation system. The 
second will be to collect baseline data (evaluation ratings, attltudlnal 
data, training data) for the purpose of evaluation of the new system. 

The design specifies ORE responsibllit es and activities in four major areas: 

1. Competencie s. ORE activities include a literature survey of professional 
personnel ompetencies, a survey of competency Instruments, coordinator 
input into coupetencies, a survey of all the professional level personnel 

in ^he district on the importance of various competencies and the development 
of an evaluation instrument based on these surveys « 

2. Profes s ional Personnel Evaluation Handbook . Activities Include collecting 
data on what AISD staff believes should be Included as a backup for a new 
evaluation instrument^ whal the district staff feels are the problems 
with the current evaluatio«i system, and the technical Inputs of the 
development of the new Professional Personnel Evaluation Handbook. 

3. Evaluator Training . Activities Include a survey of. AISD staff on their 
views < I what skills evaluators need to carry out the new evaluation system 
and the evaluation of the training conducted for evaluators in tha new 
system. 

4. Evaluation of professi on al personnel evaluation system Itself . During 
.977-78 activities include gathering baseline data on the current ratings 
given In the current system and attltudlnal data on the current system. 



Scope of Design ; 
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282 Secretary 



VII. MINIMUM COMPETENCY 



ERIC 



152 



FINAL REPORT 



Evaluation Flndlngg on : Minimum Competency 
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Summary ot Evaluation Findings : 



WHAT ARE THE HIGH SCHOOL GRADUATION REQUIREMENTS IN READING AND MATH? 

The Texas Education Agency (TEA) requires that students begin language arts 
and mathematics courses in the quarter in which they enter high school and 
that they continue those courses until the student has earned 6 quarter 
credits in mathematics and 9 quarter credits in language arts. 



Students are given several opportunities to demonstrate proficiency in 
reading and math before completing the final quarter of courNework in math 
and/or reading. Those students who have not reached the required level 
of proficiency by the time they have completed the 6 quarters of required 
math courses, must enroll in the Fundamentals of Math Tutorial (FOMT) class 
until the student meets competency or submitu a letter of waiver. Similarly , 
those students who have not demonstrated competency in reading by the time 
they have completed 9 quarters of language arts, must enroll in a reading 
tutorial class. The reading tutorial classes will begin in the fall quarter, 
1978. There were pilot reading tutorial classes at LM and Reagan (only) 
during the 1977-78 school year. 





In 1975, the Board of Trustees of 
the Austin Independent School District 
mandated that students be required 
to demonstrate at least an 8th grade 
competence in both reading and mathe- 
matics prior to graduation or to 
place on file at the school, a 
letter signed by parent or guardian 
acknowledging that the student 
proposes to graduate without 
achieving such competency. The 
requirements are effective beginning 
with the graduating class of 1978-79. 
These minimum competency requirements 
are to be met in addition to the 
course requirements in language arts 
and mrthematics set by TEA. 
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MINIMUM nST 8COU8 NECI88ARY 
FOR DEMONSTRATING PROPICIENCY 

IN READING AND/OR MATHEMATICS 
FOR 

HIGH SCHOOL GRADUATION 



Tasc And 

,Admlnlitr«cloQ 


MtQing 
PjiquiraBtnt 


natnematlcs 
Requirement 


OPTION 1: 

CAT, Ltvtl 4, Form A, 
vh«n adalnlsttrtd to 
8bh gradt itudtnta 
as part of tht dls~ 
trlctvldt ttstlng 
prosraa (in Ftb.) 


Rtading Total 
Raw Scort " 35 
- or hightr 
Ptrctntilt Scort 
* 50 or hightr 


Ma theme tic Total 
Raw Score ■ 58 or higher 
Percentile Score ■ 50 or 
higher 


OPTION 2: 

STEP, Ltvtl 2, whtn 
admlnlsttrtd to high 
school sttidAAta Am 

part of tht district- , 
wldt ttsting program 
(in A^ril) 


Rtading 

Raw Scort - 28 

For both Form A and 
. Form B. 

Minimum acctptablt 
ptrcontilt score by 
gradt 
9th grade - 30 
10th gradt - 21 
11th gradt - 15 
12th sradt « 11 


{• 

(1) Mathematics Computation 
Raw Score - 26 or higher 

0^ Form A 
Raw Sobre - 27 or higher 

on Form B 
Minimum acceptable 

percentile score by 

grade 

9th grade - 35 
10th grade - 29 
11th grade « is 
12tK £rade - 20 




- 


(2) Mathematics Basic Con- 
. eepts 

R4%r Score « 20 or higher 
on Form A 

Raw Score ■ 21 or higher 
on Form B 

Minimum acceptable per- 
centile Scores by 
grade 
9th grade - 37 

10th trade ■ 33 

11th gradt - 30 

12th aradt - 27 


OPTION 3: 

CAT, Ltvtl 4, Fom B, 
when admlnisttrtd to 
high school studtnts 
as dirtcttd by^ORE 


Rtading Total 
Raw Scort ■53 

or hlghtr 
Ptrctntllt Score - 50 

or hlghtr 


Mathematics Total 
Raw Score * 55 or hlghtr 
Ptrctntilt Scort ■ 50 or 
hlghtr 



Figure 1 
VU.2 




HOW MUC H HAVE FOMT CLASSES HELPED STUDENTS IN MEETING COMPETENCY REqUIREMENTS ? 

It was found that 5S4 students enrolled in FOMT during 1977-78, the first 
year In which the math tutorial clasRea were operational. Of this group, 
42. 3X met competency after only 1 quarter. "\ 
Another 7.4Z demonstrated competency after 
2 quarters and another 1.1% demonstrated 
competency after 3 quarters. It should 
be noted that only one group of students, 
those enrolled in the fall quarter of FOMT, 
have had the opportunity to enroll in FOMT 
for 3 tiuarters. By the end of the year, 
however, a total of 50.8% of those students 
who had failed to meet competency by the 
end of lOth grade and who had completed 
at least 6 quarters of high school math, 
and who had subsequently enrolled In FOMT* 
did demonstrate competency In mathematics. 

There is some question, however, as to whether these students actually 
acquired sufficient skills as a result of enrollment in the FOMT class, 
or whether they were remembering items from the previous administration 
of the test. This is a very serious question since the same form of the 
test (CAT, Form B, Level 4) is administered at the end of each quarter 
to the FOMT classes. Some consideration will need to be given to this 
matter in order to get a more accurate picture of the impact of the FOMT 
classes. 

Another quertlon that Is raised by the findings on this question is how 
iiuch change in student performance is due to an increase in student moti- 
vation. Before 1977-78, students did not have to meet a specific level 
of proficiency in order to graduate. It is likely that the 1977-78 stu- 
dents pu: more effort into their test performance because their eligibility 
for graduation depended upon it. 

For whatever reason, those students who comprised the study group for 
1977-78 did show improvement over the previous year*s students having 
similar backgrounds with respect to testing. (See Figure 2) 

ARE ANY STUDENTS EXEMPT FROM THE COMPETENCY TESTING 
REQUIREMENT? 

Students were exempt from the competency testing 
only if they: 

. were in an Integrated or self-contained 

special education classroom. 
. transferred to the Austin Independent 

School District with at least one 

quarter of senior-level credit earned 

In the non-AISO district. 
• Entered high school before 1974-75 

(before the board policy on competency 

requirements had been adopted). 
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EUVIMTH GRADE 1976-77 
BUCK(N-lOl) 

MCX.-AHIIl.(N«106) 
ANGLO (N- 92) 



ELEVENTH GRADE 1977-78 
BUCK(N- 98) 
HEX.-ANER.(N-121) 
ANGLO (N- 121) 




25% 20% 15% 1 



01 



5X 101 15X 201 ZiX 



Figure 2. PERCENtAGE OF STUDENTS FAILING THE COMPETEUCY REQUIREMENT 

AT 8TH GRADE LEVEL WHO PASSED THE STEP AT ELEVENTH GRADE LEVEl. 
PRIOR TO AND AFTER THE GRADUATION REQUIREMENT WENT INTO EFFECT 



WHAT SCORES MUST BE MET IN ORDER TO DEMONSTRATE 8TH GRADE PROFICIENCY? 

In order to demonstrate competence in reading and/or math, students must 
achieve a satisfactory score on any one of the following tests; 

. the California Achievement Test (t:AT) administered at 8th grade, 
on which the student must score at or above the 50th percentile 
level based on the CAT norms for the December-February adminis- 
tration of Level 4, Form A. 
. the Scr tentlal Tests of Educational Progress (STEP), administered 
n'taliy at the high school level, on which the student must score 
or above the level indicated in Figure 1 for the respective 
grade and subject area (I.e., reading or mathematics). 
. the California Achievement Test administered at the high school 
level, on which the student roust score at or above the 50th 
percentile level based on the CAT norms for the December-February 
administration of Level A, Form B. 
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HOW FK) PARENTS AND STUDENTS KNOW WHAT 
STUDENTS ARE FACING THIS YEAR? 

During 1977-78, there were at least 
two articles which appeared in a 
local newspaper regarding the Austin 
ISD competency testing program. The 
articles were written by the Director 
of the Office of Research and Evaluation. 

The television medium was also used to 
try to inform the public about the 
minimum competency requirements. 
Appearances were made by the Director 
of Secondary Instruction and the Director 
Evaluation. 

Just before students enter high school (during their 8th grade year), they 
are provided copies of the "Blue Book", the school district guide to ir- 
formation on school district policies and regulations which Austin high 
school students and their parents should know. The graduation require- 
ments, including both competency requirements and course requirements 
are Included. 

Students at both 8th grade and at the high school level are provided with 
brochures describing their test results on the 8th grade California Achieve- 
ment Test and the Sequential Tests ot Educational Progress (at grades 9-12) 
respectively. Th«!se 1 jchures include information on the minimum competency 
requirements and how that specific tests and the test results fit into the 
competency testing program. 

SHOULD OTHER STUDENTS BE REQUIRED TO TAKE FOM CLASSES? 

The findings on this question are not conclusive. It is clear that the 
students "who take only advanced mathematics classes do better on the STEP 
than do students who have been enrolled in FOM classes. (See Figure 3). 
This finding may be the result of differences in entry-level skills pos- 
sessed by the student at the time of enrollment in FOM or advanced math 
classes. It Is suggested that a study be made to compare the entry level 
skills of students in advanced math (e;g., algebra, geometry, etc. — 
courses other than FOM) and those who enroll in the Fundamentals of Math 
(basic skills) courses. 

Just as there Is a question on the findings of differences between FOM and 
non-FOM students, the quest; >f FOM and FOMT student differences has not 
yot been addressed. In loo: i. at the progress of FOMT stuHents; however, 
the fact that 50. 8Z achieved ...mpetency during the 1977-78 school year was 
Impressive, particularly since 42. 3Z met competency after only one quarter 
in FOMT. (See Figures 3 through 6) 
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Figure 3. PERFORMANCE OF STUDENTS IN GRADE 9 ON STEP MATH COMPUTATION 

(STEP ADMINISTERED TO 9TH GRADE IN 1977/78). Non-FOM studtnts 
are these who have taken only advanced math courses (e.g., algebra, 
geometry, etc.). FOM students are thoae who have been enrolled 
for at least one quarter in Fundamentals of M«*tl' >T)M). 
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Figure A. PERFORMANCE OF STUDENTS IN GRADES 9 ON THE STEP MATH CONCEPTS 
(ADMINISTERED TO 9TH GRADE IN 1977/78) . Non-FOM ftudents 
are those who have taken only advanced math couraea (e.g., algebra, 
geometry, etc.). FOM ftudenta are thoac who have been enrolled 
for at least one quarter In Fundamentals of Math (FOM)« 
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Figure 5. PERFORMANCE OF STUDENTS IN GRADE 10 ON STEP MATH COMPUTATION 

(STEP ADMINISTERED TO lOTH GRADE IN 1977/78). Non-FOM students 
are those who have taken only advanced math courses (e.g., algebra, 
geometry, etc.)* FOM students are those who have been enrolled 
for at least one quarter in Fundamentals of Math (FOM). 
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Figure 6. PERFORMANCE OF STUDENTS IN GRADE 10 ON STEP MATH CONCEPTS 

(STEP ADMINISTERED TO lOTH GRADE IN 1977/78). Non-FOM studentn 
are those who have taken only advanced math courses (e.g., algebra, 
geometry, etc.). FOM students are those who have been enrolled 
for at least one quarter In Fundamentals of Math (FOM). 
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HOW MANY STUDENTS OPTED FOR THE WAIVER LETTER? 

There were a total of 41 letters of waiver in mathematlce received by 
the high schools during the .1977-78 school year. Three of the students 
who submitted letters later took the CAT In the FOMT class and passed. 

Of tne 38 remaining students who submitted letters, 60. had- been- 
enrolled In FOhfT for 2 or 3 quarters. This represents 18% of the 209 
students who would not otherwise graduate, thus leaving 171 who wlfl ;* 
not have met competency by the end of 1978-79. 

There Is considerable difference among schools In the number of letters 
received. This is thought to be due, at least in part, to the fact that 
some schools actively discourage students from submitting waiver letters 
and strongly encourage (insist) that they repeat FOMT until competence 
is met or the student Is about to graduate. - 

Figure 7 11 atrates the number of students, by ethnic group and by 
scViool, for whom letters have been recleved. 




Figure /. NIIMBKK OF STUDENTS WITH ACCEPTED WAIVER LETTERS FOR MATH 
COMPKTKNCY. 




VII. 10 



10 WILL GRADUATE? WHO WILL NOT? 



With each succeeding grade, there Is a smaller percentage of students 
who have failed to demonstrate competency. Anglo students attain com- 
petency In earlier grades than do minority students. Figure 8 displays 
these results. ""^^ 



Test 


Grade 


Black 


1 


Mex . An . 


Anglo 




8 


8A.5Z 




80. 3Z 


30.9% 




9 


73.6s: 




72. « 


22.2% 


Reading 


10 


61. 8Z 




49. 9X 


12.3% 




11 


32. 3X 




30.5% 


5.0% 




12 


38. 7s: 




29. AX 


6.6% 




8 


82. 3Z 




77.53: 


3A.9% 




9 


82. 7Z 




78. IZ 


31.6% 


Math 


10 


70. 




56.0% 


17.7% 




11 


33. 2s: 




23.8% 


A. 5% 




12 


53.87. 




A8.0% 


U.9% 



Figure 8. PERCENTAGE OF STUDENTS FAILING TO DEMONSTRATE COMPETENCY, 



BY GRADE AND ETHNICITY. 
OF 1977-78. 



DATA IS REPORTED AS OF THE END 



Further improvements are expected next year. It is predicted that by 
the end of next year, only 3% of the seniors (11th grade students during 
the current year) will have still failed to demonstrate competency in 
reading. Four percent of these seniors will have failed to demonstrate 
competency in math. 

So far, only a few students are taking advantage of the waiver letter 
option. At the close of this year only 7% of those students taking Math 
tutorial classes had submitted waiver letters. 
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quaatlona ara atatad and ara ralatad 
to tha ralavant avaluation quaatlona. 

a 

Thla aactlon brlafly daacrlbaa the 
projact and tha avaluation actlvltlaa. 

Tha apadflc analyala procaduraa for 
aMch of tha avaluation quaatlona ara 
praaantadi in thla aactlon. 

Thla aactlon eontalna a tlaallna for 
tha data collactlon actlvltlaa. 

Thla aactlon aunaarliaa all of tha 
avaluation vovk aatlmataa (In paraon- 
daya) by poaltlon, for aach aapact of 
tha avaluation. 



Thla daalgn rapraaanta tha avaluation plana for tha aaaaaamant of tha 
conaaquancaa of tha raeantly adoptad board policy regarding minimum 
conpatancy raqulramanta and of tha actlona takan by tha dlatrlct to 
aaalat atudanta who naad additional halp to damonatrata tha raqulrad 
mlnlmuB conpatanclaa In raadlng and In math. 

Tha avaluation daalgn conalata of providing achlavamont data raaulta 
for all ttudanta currently In high achool and In tha 8th grada of tha 
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Publicitlon No. 77,09 



Junior High School! , for tht purpott of dtterlblng: 

. projtcttd InpllcAtlons for Ch« ttnlor class of 1978-1979 
(ths first clMS which will graduats undtr tha compatoncy 
raqul..aBants policy) , 

. current conp%tancy status of all high scnool and 8th gradt 
studmits, on a dlstrlctvlda baslA as wall as by dlffarant 
athnlcltlas and school caiipusas, 

tha affactlvcnass of tha apaclal tutorial classat .at have 
bean condur.ted during the 1977-1978 year for students who 
havt. not been able f.o demonstrate competency In math, and 

. the adequacy of the equating procedure which the Office of 
Research and Evaluation used to determine cutoff scores on 
the high school STEP test which irauld be considered as 
equivalent to the 50Zlle cutoff scores on the CAT. 

Other data was collected to a'^sesa soir.e of the other Important 
aspecfs of the board policy and the corresponding administrative 
procedures. This Included class sizes for the tutorial classes, 
attendence rates In these tutorial clashes, and the frequency with 
wh.ch the letter of waiver option (permitting students to graduate 
without having; demonstrated competency. If the parents or guardians 
appro^'ed by signing the letter) was being utilised In the district. 

Scope of Design ; 

A Decision Questions *i 
13 Evaluation Qvestions 

Evaluation Resources Required (in person-days) : 

9 Director 

50 Senior Evaluator 

50 Data Analyst 

50 Testing Techulcians 

22 Secretary 



Publieitioii No. 77.09 
(Evaluation Datlgn) 



- . ABSmCT , 

Tltla ; Minimum Compatancy ^ , ' - 

Coi tact Paraon : Jamas Watklns^or Jana Ogdan 
No.' Pagas ; 17 , 
Contant: 

Tha avaluatlor. daslgn Is a ona-yaar plan of evaluation work for tha 
projact*.: Tha tabla of contents for this documant Includes: 

I. Evaluation Design Review Form Thla form praiTents the names of persona 



II. Decision s.ssClons # 

III. Narrative Summary 
ZV. f Information Sources Summary 



. V. Summary of Data to be 
Collecteu 

VI. Evaluation Time Resources 
Allocation Summary 



who are responsible for some aspect of 
.the project's Implementation and who have 
bean provided with relevant portions 
af the design for review and comment. 

In this section, all of the decision 
questions are stati^ and are related 
to the rtlevant evaluation questions. 

This section briefly describes the 
project and the evaluation activities. 

The specific analysis procedures for 
each of tha evaluation questions are 
presented In this section. 

This- section contains a timeline for 
the data collection activities. 

This section sunnar/sas all of the 
evaluation wcrk estimates (In person- 
days) by position f for each aapect of 
the evaluation.. 



Evaluation Design Sumnmry ; ^ s . ' • 

Ti^llr'^des ! gn represents the evaluation plans for the assessment of the 
consequaaces of the recently adopted board |/ollcy kegardlng minimum 
compttfificy requirements and of tha^ actions taken by the district to 
assist students who nsad additional help to demonstrate the required 
minimum competancias in reading and InWth. 

The eve 'nation design consists of proi/ldlng Achievement data results 
for all jtudents cuifrrently in high school ard in the 8th grade of Nthe 
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Junior High Schools, for th« putipoio of doicrlblng: 

# * • 

. projoctod laplleatlocM /or th« ••nlor class of 1978-1979 
(ths first class which will graduata undar tha coiapatancy 
raquiraiMnta policy) , 



. currant conpatancy status of all high achool end 8th grada 
atudtnta, on a dlatrlctwida basis aa wa.l as by diffarant 
athnicitlaa and achool cani osaa, 

tha affactivanaaa of tha apadal tutorial claaaaa that hava 
baan conductad during tha 1977-1978 yaar for stbdanta who 
hava not baan abla to daaonatrata coaq)atancy in math, and 

tha adaquacy of tha. equating procadura ^ich tha Of f ica of , 
Raaaarch and Evaltiation usad to dattrmina cutoff aboraa on 
tha high achool STEP taat which would ba conaldarad aa 
aquivalant to tha SOZila cutoff acoraa on tha CAT. 

Othar data was collactad to assass soma of tha othar inportant 
aapacts of tha board policy and the corresponding adtnlnlatrativa ' 
procaduraa. Thia Includad clasa slzaa for tha tutorial daaaas, 
attandanca rataa in thaaa tutorial claaaaa, and tha frequency with 
which the letter of waiver option (permitting atudents to graduate 
without having danonstrated competency,, H the parents or guardians 
approved by sigaing tha letter) was being utilized In the district. 

Scope of Design ; 

4 Decision Questions 
13 Evaluation Queatlona 

Evaluation Raeourcea Required (in peraon-daya) ; 

9 Director 

30 Senior Evaluator 

50 Data Analyst 

50 Tea ting Techniciana 

22 Secretary ^ 
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VIII. LOCAL/STATE BILINGUAL 



erIc . 



FIMAL- REPORT 



Evaluation Finding on; Local/Staca Bilingual 



Contact Paraon : Lynn Cayanaa and Glynn Llgon 



Sumnary of Evaluation Flndlnga ; 



Daacrlptlon of tha Program 

' " ' '■ • 

'Th« ^cal/Statc Bilingual Prograa In tht Auatln Indapandant School Dlatrlct' 
racal^iWa funda from tha Dlatrlct and tha Stata of Taxaa In tha amount of 
$520,902 to provlda bilingual aducatlon to aalacted ^atudanta attending tha' 
public achoola In Auatln. 

Tha Locaiystate Bilingual Program oparataa^^on algbtaan campuaa^ ahd apana 
gradas K-S. • Approximately 4,343 atudanta participate In Local/State funded 
bilingual Inatructlonal acftlvltlea. About 3,373 of theae' atudanta' attend 
achoola where the Title VII Project la In operation and are admlnlatered to 
In part by tha Title VII Project Staff. The Title VII campuaea are alao 
known aa High Concentration Bilingual Campui at (HCBC*^. Tha^ remaining 
970 atudanta attend achoola it campuaea where there are lower concentrationa 
of Spanish- aurnamed atudanta (LCBC'a). The program for atudanta In thia 
latter category la admlnlatered entirely by Local/State Bilingual 9taff. 

Tha Local/Stata Bilingual Projact la admlniatarad and auparvlaad by ajtaff 
of aevan profaaalonala-^-a projact coordinator! flva .Inatructlonal'^paciallata 
and a parantal Involvamant apaclallat.; Thaaa ataff mamk)ara'^ara raaponalbla 
for tha Implamantatlon of tha two componanta of tha program: tha Inatruc- ' 
tlonal componant and tha parantal Involvamant componant* Evaluation of tha 
parantal Involvamant componant waa not Includad In tha application to TEA| 
tharafora no daclalon quaatlona vara ralaad by tha bilingual program ataff 
daallng vlth thla componantf Taachera at alx of tha low concantratlon 
bilingual campuaaa ara aaalatad by bilingual raaeurca taachara* Although 
aach ataff mambar la aaalgnad tha raaponalblllty of facilitating har eottpo- 
ncnti each alao auparviaaa claaarooma at tha HCBC^a and LCBC*a and cohtri- 
butai to planning and implamantatlon of all componanta. 



Evaluation Purpoaea * 

The primary focua of the evaluation la the aaaaaimant of the objrctivea In 
language development and concept development* Project atudent outcome 
object ivea were meaaured In the areaa of oral language development, readli-. 
math and aecond language acqula..tion. In addition » information waa gathered 
which will aaalat AISD in making deciaiona relevant to bilingual education 
throughout the Dlatrlct* The major qtieetion addreaaed in tha 1977nl978 
evaluation waa that of Identifying atudenta of Ximlted Engliah-apeaking 
ability (LESA). 

Vlll.l 



Ev al|irtitlon Actlvltlti 

bu^coma tvaluatlon Involvtd tht ust of a varltty of InstruflMintt admlnltttrtd 
mainly to stU'cttd samplaa of projtct and non-projact atudanta. In addition 
to a locally davalopad taat for math In Spanlah, four atandardlsad taata wara 
admlniatarad to aaeaaa Spanlah raadlng, languaga domlnahca» and Engliah 
raadlng» 



E valuation Flndlnga . 

Tha raaulta frbm the evaluation flndlnga are preaantad hare according to 
the four declalon queatlona which tha Local/State Bilingual Project muat 
addreaa. Thla Infbrmatlon la aeen aa contributing to the anavering of 
theae declalon queatlona along with the ptoject etaff'a obaervatlona and 

the political and practical conatralnta Impoaed upon the project. 

Deaiaion Queeticn I: licki ehoutd AISD bilingual program reeourate he « 
allocated in 19?8^?9 to Hiapanity atudenta who apeak: atrong Engliah, weak 
Spaniah; atrong Engliah, no Spaniah; atrong Engliah, atrong Spanish; weak 
Englieh, atrong Spaniah; weak English; weak Spaniah; no Engliah, atrong 
Spanish; no Engliah, weak Spaniah? 

*The concept of equal educational opportunity of language minority children 
haa exlated for miiny yeaira. The flrat federal leglalatlon dealing with thla 
iaaue vaa tha Fourteenth Amendment (1868), which eatabllahed the principle 
of equal opportunity. Almoat one hundred yeara later the Civil Rlghta Act 
(1964) • eatabllahed the principle of equal educational opportunity for 
national origin minority groupa. 

The court caae which haa had the greateat impact on bilingual education la 
that of Lau va Nichols . Aa a reault of thla caae the Remtdlea were 
wrif-en. theae guidelinea provide federal regulatlona by which the Office 
for Civil Rlghta conduct^ reviewa of compliance by achool dlatrlcta, and 
apecify guidelinea which achool diatricta may uae to develop' and implement 
Lau compliance plana. 

The Lau Remediea apecify that if a child haa a home language other than 
Engliah he may or may not be conaidered LESA. If the atudent meeta the 
LESA qualificationa and la attending a achool diatrict which haa twenty or 
more atudents who apeak that language/ the child must receive instruction 
in his dominant language. 

In Texaat a state supported bilingual education program is required . for LESA 
students in grades K-3. According to the Texaa Education Agency, a bilingual 
program muat contain aix componenta. These include: 

A. The baaic concepta atarting children in the school envlroment are 
taugl t in the child's first language* 

b. Langi age development la provided in the child's first language.' 

c. Language development la provided in the child's second language. 

d. Subject, matter and concepta are taught In the child's first 
language. 

e. Subject matter and concepts are taught in the child's second 
languagei 

f. Specific attention 1 given to Instilling in the children a poaitive 
Identity with their cultural heritage, self-aaaurance, and confidence. 
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In addition, instructional staff for alamentary bilingual programs who 
provida instruction in two languages nust have elementary certificstes with 
bilingual education area of specialisation or bilingtial endorsements. 
Teachers of secondary programs must have a secondary teaching certificate 
appropriate for the course for which credit is given. ITtey should also 
complete a methods and techniques workshop designed for secondary programs 

for limited English speakers designed by TEA. 

»./-•. 

The local requirements for bilingual education are outlined in the School 
Board Policy on Bilingual Multicultural Education, which was a<lopted 
September 9, 197A. This' policy is basically a restatement of the six 
components mentioned previously, with the additional option of a mainten- 
ance program which could be developed beyond the third, grade, enabling a 
student to receive bilingual instruction on a voluntary basis. 

In Decision Question 1, the Local/State Bilingual program specified sever, 
language categories for LESA students. No figures are available concerning 
the number of students in each of those categories. Similar categories, 
however, were used in the language dominance grouping prepared by the 
Department of Bilingual Education in January of 1978. The totals are sum- 
marized In Figure 1. 
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Figure 1. UkNGUAGE DOMINANCE CATEGORIES FOR STUDENTS IN SCHOOLS WITH 
BILINGUAL PROGRAMS 



V^msion Queetum P.: HoiJ shduld loaal bilingual vcBourcee be allooated 
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Wh«n making thli daclBlon, It It nccettary to uontlder how other rtiourcet 
for bilingual education are allocated. During the 1977-78 echool. year the 
Local/State Bilingual program eerved both high and low concentration bilin- 
gual campueee. Low concentration bilingual campueee received local and 
•tate funde from the local dletrlct and State of Texae only. ' 

The total expendlturee for the low concet^tratlon campueee» Including 
materlalH, pereonnel coete, reeource teacher ealarlee and all other cate- 
gorlee ahown In Figure 2, reached S397,423\ The nine high concentration 
campuses received materials and 'iKfrvlces totaling $147,736 from the local 
funds. •• 

The money allocated to Individual low coi^centratlon achoola ranged from ^ 
$22,969 tor Brentwood to $42,969 which was Llnder'a portion of the total 
funds. This variation In funding la attributed to numeroua factors. 
Schoola which had been In the project In previous years received sllglhtly 
less and schools without bilingual personnel were served by resource 
teachers who were paid by local funds. The number of project students at 
each cai.pus also Influenced the amount of money, allotted to each echool. 
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Figure 2. BUDGET A1.L0CATI0NS FOR LOCAL/STATE BILINGUAL CAMPUSES AND 
HIGH CONCENTRATION BILINGUAL CAMPUSES 



The funding for high concentration campuses Is also shown In Figure 2. No 
funds were allotted for materials or evaluation since the grant from Title 
VII covers those areas. Local funds paid aides and resource teachers and 
also provided for the services of supervisory personnel to some schools. 

The District also, received funds from, tlfle ESEA Title VII Project totaling 
$62cl,681.00 as Illustrated In Figure 3. The difference In funding from 
one elementary campus to another Is due to the allocations for consumable 
and non-consumable supplies. The schools received a specific allotment 
for each project student, therefore, the schools with the most project 
students received the most money for those supplies. ' 
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Figure 3. ESEA TITLE VII FUNDS ALLOCATION FOR 1977-78 

DeerLfiion Queetion 3: What criteria and prooedurea ehould bi. ueed for 
idmtifying LESA (Limited Englieh* Speaking Ability) etudenta in AISD? 

During the 1977-78 school year, LESA students were Identified as those 
who had a score of one Or greater on the Spanish scale of the PAL Oral 
Language Dominance Measure. 

In addition, those students who had previously been identified as LESA were 
also Included. Finally, the Office of Research and Evaluation estinated 
the number of students who may have been missed in one of the above identi- 
fication procedures and added these studeftts to the LESA category. 

When other methods of identifying LESA students were conducted, the results 
were comparable. PAL language dominance classifications from fall, 1977, 
were compared with the teachers' Judgement of their students' dominant lan- 
guage in May, 1978. Teachers were asked to specify language dominance with 
no option for a bilingual classification. Those students who were identified 
as Spanish dominant on the PAL were also judged to be Spanish dominant by the 
teacher. The same was true for English dominant students. Those few stu- 
dents who, according to the PAL, were bilingual had to be considered either 
English dominant or Spanish dominant by their teachers according to instruc- 
tions from ORE and therefore the accuracy of the bilingual designation , 
could not be verified. 
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Du« to the correlation of the PAL results and teacher Judgemental It appeara 
that the Dlatrlct ahould continue to uae the. PAL aa part of the LESA 
Identification proceaa. Since atudenta above the third grade level muat 
alao be Identified aa LESA or non^-LESAi the Dlatrlct eatabliahed a LEdA 
committee to conaldfl^r procedurea for Identifying theae atudenta. Thla 
conmltteei cofl|poaed 6f school admlnlatratora, teachera» and parenta» met 
numeroua times In the spring and aummer of 1978 to survey language dominance 
measures, study federal, atate, and local regulatlona concerning LESA 
atudenta, and propose procedures for Identifying students who are of limited 
Engllah'-apeaklng ability* 



The recommendations of the:\commlttee will be presented prior to the next 
school year ao that thte procedures can be finalized and Implemented during 
reglatratlon In August, 1978,,^ 

Deoiaion Question 4: Should ahta^gee be made in the objeativee of the 
program? 

Objective 1: Acquisition of Math Readiness Skills In Spanlah and English , 
Kindergarten On the Boehm Teat of Baalc Concepta the Engllah dominant 
kindergarten atudents In the project dempnatrated acqulaltlon of math 
readlneas skills through Instruction In English. Non-project students who 
were tested also Increased their average scores algnlflcantly. There vaa 
virtually no difference In the scores of project and non**project atudenta. 
Aa llluatrated In Figure 4 even though project students come from homes 
where Spanlah Is spoken they appear to be no more language disadvantaged 
than students from non-Spanish speaking backgrounds. 



LESA students In the bilingual 
schools scored higher on tne 
Boehm than students from the 
HCBC*8. Too few Spanish domi- 
nant students were admlnlatered 
the Boehm, In Spanish, to calcu- 
late significance. 

Since all of the average gains 
for project and non-project atu- 
dents on all scales were slgnlfl- 
; cant, perhaps some change In the 
objectives needs to be made. It 
would be helpful to make the 
objectives more explicit by 
stating the percentage of stu- 
dents who are to make a specific 
gain. In fact, the objectives 
for first graders to be measured 
by the CAT are expressed In this 
manner. 



It m 

1« m 

14 « 
It « 

• « 

a M 



iiri 



MICTftT 



MITTItT 



Uti&L. 



S4 



t.O 



1M4 



).}% 



Figure A. BOEHM QUANTITY SCOFF*? FOP 
STUDENTS TESTED IN ENGLISH 
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ObJectlvt 2; EnRllih RtadlUR a^>d Math. First through Fourth Grades The 
California Achlevament Tast scores Indicate that more than 60X of the first 
grade students scored above the 50th percentile on all three math ^ scales « 
Second, third, and fourth grade students made gains which were significant 
on all three scales; math computation, math concepts and problems, and 
math total. More than 50Z of the first graders scored above the 60th 
percentile on the vocabulary and comprehension scales. Forty-nine, rather 
than fifty percent of the students scored above the bOX percentile on the 
total reading scale. Second, third, and fourth grade studrmco xi\c(\n id.gnX- 
f leant gains on all three reading scales. 



Overall on the CAT, students met 23 
of the 24 objectives. This could 
be misleading, however, since the 
objectives were not very specific 
as to the outcomeB expected. Objec* 
tlves could specify the comparison 
of scores between project and non- 
project students but It is difficult 
to find comparable groups. Again, 
the solution appears to be the 
specificity of the objective. As 
was the case with the objectives 
for the first grade, the objec- 
tives should be stated In terms 
of the percentage of students 
who will achieve at a certain 
level. 




Figure ,5. 
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CALIFORNIA ACHIRVFMENT 

TEST READING SCORES 

FOR FIRST GRADE STUDENTS 



Objective 3: Math Skills In Spanish, First through Fourth Grades Spanish 
dominant third grade students made slgi^lflcant gains from pre* to posttestlng 
on the Spanish Math Test - Examen de HatemHtlca en Espaflol (EME). First, 
second, and fourth grade students did not meet this objective when their 
scores were considered separately by Individual gtade level. However, when 
all scores for all project students In grades 1-4 were combined the average 
gain was significant thus Indicating that overall the stuuents met the 
objective, but the small numbers at f^ach grade level prevented most grade 
levels from being considered statistically significant. 



When using a test such as the EME which 
was developed locally, stating objec- 
tives In tenM of significant gains 
may be the best alternative since no 
other norms are available. Since there 
are no norms based on a comparable 
group of students it would be benefi- 
cial to use the gains for 1977-1978 
as the basis for setting the objective 
for the 1978-79 school year. 



Figure 6. SPANISH MATH TEST (EME) 
TOTAL RAW SCORES FOR ALL 
STUDENTS ThSTED 
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Oblacttva 4: Ungu^aa Skllla In thm Plrit and Stcond UnguAM^ KindTMrf n 
and Flr«t Grade Tha objac».lvaa for project atudenta which were meaaured 
by tt)e PAL Oral Language Dominance Neaaure appear In the follovlng figure. 
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S^fiiph iMHuagi k;kilU vill IficrMii for flnni^H 4««iliMiiit klndirMrtm ■tu4tfiti 
9|Miih lM»u«t« •kiU9 vlU incraaia for 8MAi«k dmilMiit firit |ra4« ■tiidmtt 
SHNtiiH la«|uM" siiiHi vill incrtMi for ln|llih dimlniiiit liMtrMrtMi ■tii4Mti 
npwkUH l•fm^^ •kilU vill incxMB for Bfifliili dmiiMiiit fine iradi ■tudantt 
l^liih iMftuAM iliilli vill liicrMaa for Ififliih dpvinaiit klMfrMrtcn ■Kudmiti 
l«tlt«H iMdUAia ikilla will iocrtatt for Biiillah 4o«iMiit firat irada attidanca 
Bagliali laniuaia akilla vill incraaaa for SmbIiH dosiMar WMargartaa atudanta 
BafliaH laatuafa aktlla vill Incraaaa (oc 9Mni>^ daaiimt firat grada atudania 

Figure 7. PROJECT OBJECTIVES MEASURED BY THE PAL 
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All of the objectives which w^re not met dealt with the developnent of 
Spanish language skills. It appears that these skills are not enphaslsed 
In the curriculum at the LCBC's since these same students Increased their 
English language skills significantly. 



Objective 5; Spanish Readlna Skills* Second Through Fourth Grades Second 
through fourth grade project students were administered the Prueba de 
Lecture - Spanish Reading Test In Hovenber, 1977, and again in April 1978. 
Second grade students did not meet the objective concerning Improved Spanish 
reading skills. None of the gains on any of the reading scales was signi- 
ficant for these students. Third grade students did not meet the objective 
since their average gains on the comprehension scale were not eignificantp 
Fourth grade project students did not meet the objective either. There was 
no significant gains on any of the three scales. Figure 8 shows the scores 
on the total raw score scale. In all, 
the comprehension scale presented the 
most difficulty since none of the grade 
levels, when considered separately, 
made significant gains on this scale. 
However, when the scores for all the 
students at each grade level were com- 
bined, the average gains on all three 
scales were significant. 
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Figure 8. SPANISH READING TEST - 
PRUEBA DE LECTURA TOTAL 
RAW SCORES FOR SECOND, 
THIRD AND FOURTH GRADES 
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Objfctlv 6: laprov— at In Unauaaa Devlopmant In tht Stcond Ungua^» » 
Second throuah Fourth Gradtt Tht Stcond Langumgt Improv«iMnt Index vat 
tdalnitttrtd In March 1978. Randomly ttltcttd ttcond through fourth |radt 
ttudtntt vtrt tvaluattd by thtlr ttachtrt rtgardlng Inprovtntnt In thtlr 
tttcond languagt. At llluttrattd In Flgurt 9 all ttudtntt (lOOX) ^n grtdtt 
2-4 who vtrt rtctlvlng Inttructlon In Engllth at a ttcond languagt Imptovtd 
thtlr languagt tklllt. Iht Engllth dominant projtct ttudtntt tvaluattd. 
excttdtd tht Itvtl tttabllthtd In tht objtctlvt. 



Studtntt vho vtrt rattd 
2, 3, 4, or 5 on a 1-5 
tcalt of Improvtmtnt vtrt 
contldtrtd to have Improvtd 
thtlr ttcond languagt tklllt. 
Tht rating of 1 vat ^tlg- 
nated at no improvtmtnt. 
Thtrt vat no mtntion of 
tignificanct or a tptci*- 
flcation of tht ptrctntagt 
of ttudtntt vho nteded to 
mttt tome crittria in the 
objtctivt. Thut, tht 
vording of the objective 
appeart tx: bt tht main 
reason that tuch a largif 
percentage of the ttudents 
mat the objectivet. 
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/^ure 9. SECOND LANGUAGE IMPROVEMENT INDEX 



Object i ve 7: Observatl o,i of Blcultugal Displaya/Activitiett, All Project 
Clattroomt Tht final objective concerned the obtervation by bilingual 
Mtf^ft of bicultural ditplayt/activititt on at leatt one half of their 
vltitt to project claatrooiOAt. Eight of the nine schoolt met the objective. 
Whi/n the retultt from all tchoolt vtrt totaled by grade level, all grade 
levi2lii met the objective, at thovn in Figure 10. 
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Figure 10. BICULTURAL DISPLAYS /ACTIVITIES RECORH 
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The ovtrall sunBary of the attalnnent of objective! le presented In Figure 11; 
All of the objectives dealing with Instruction In English were met. ?our of 
the five objectives concerning Instruction In Spanish were not met. / 
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•Not snough studsvts tsst*d to dtttscmlns signif icsncs 

Figure* !!• SUMMARY OF PROJECT OBJECTIVES 



Summary 

Teachers In the Local/State Bilingual Project hod bicultural displays in 
their classrooms or conducted bicultural activities during more than fifty 
percent of the visits by project supervisors. In addition, according to 
their teachers, at least 98% of the students Improved tfieir second language 
skills to some degree. 

By August 1978, AISD will have a standard policy and procedure for the 
Identification of LESA students which will be based on information collected 
by the District LESA Committee, 

Students met all of the objectives when Instruction was in English; however, 
four of the five objectives dealing with Instruction in Spanish were not met. 
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Publ^ ^ton Nuab«) 77.45 
(T«d R«port) 



ABSTRACT 



Title ; Technical Report, Local/State Bilingual Program 



Contact Persons : Lynn Ceyan^.s and Paula Matusasek 



No> Pages ; 121 



Suwaary ; 

The Technical Report consists of 8 appendices. Each appendix reports 
on the Information collected by & specific data collection measure. 

Each appendix contains: 



An Instrument description 

Purpose of the measure 

Decision questions addressed 

Fvaluatlo^ questions 

Procedures ust^d to collect the data 

Suunary of the results 

Tables ^id figures presenting the data 

This technical report contains the following appendices; 



Appehdlx A 
Appiftdlx B 
Appel£llx C 
Appendix D 
Appendix E 
Appendix F 
Appendix G 
Appendix H 



Boehm Test of Bai*ic Concepts 

Oallfornli Achlfc^rement Test 

Examen de Hatematica en Espanol 

PAL Oral Language Dominance Measure 

Spanish Reading Test - Prueba de Lecture 

Second Liioguage Improvement Index 

Blcultural Displays/Activities Record 

Report on Committee for Identifying LESA Students 
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ABSTRACT 



Tit la : Evaluaci6n ^De qua consaate y por que sa llava acabo? 

(Evaluation: What does it consist of- and why ioea it take 
^ place?) 



intact Person: Lynn Ceyanee, Glynn Llgon 



No> Pages ; 7 



Content : 

yThe handout waa designed to provide the bilingual teacher;^ with 
information concerning the evaluation of thi locall^ funded blllu- 
gu4.1 program. The guide contains some of the reasona for the 
rising concern for bilingual education and its evaluation. It 
also summarizes the program objectlyes for tAie 1977-78 scho6l year. 
Definitions fov seme of the evaluation instruments and terminology 
were also given to provide % better mtder standing of the tests used 
by ORE and the interpretation of the data cQllected by the office. 



t. ( 



Publle«tlon No. 77.34 
(EvAluAtlon Design) 



ABSTRACT . . ' . 

Titles Local/State Bilingual Program (1977-78) Evaluation Heslgn 

Contact Paraon; Lynn Cayanes and Paula Matuszek 
Nq> Pages ; 13 

Content : ' 

The evaluation design Is a one-year plan of evaluation work for the 
project. The table of contents for this document Includes: 



!• Evaluation Design Review Form 



II. Decision Questions 

A* Questions Addressed 
Overview 



ill, Narrt^lve Summary 

A. Program Summary 

B. Evaluation Summary 

IV. Information Sources Summary 



V. Summary of Data to be 

Collected in the School a 

Vi. Evaluation Time ReHources 
Allocation Summary 



This chapter presents the names 
and/or signatures of persons 
{responsible for some aspect of 
the project *s Implementation) who 
have been provided relevant por- 
tions of the design for review 
and comment. 

Here the evaluator states all the 
decision questions and relates 
them to the evalurtlon questions 
and objectives (and their data 
sources) » 

This chapter briefly describes the 
project and the evaluation acti- 
vities tied to the project. 

Ttie principal evaluator(s) provide 
work estimates (In person-days) 
for each person on the evaluation 
team. Work estimates are projected 
for each "information source" and 
are broken Into the four types of 
evaluation tasks: development » col- 
lectloni analysis » and dissemination. 

This is a timeline for the collection 
of data in the schools. 

This che.\)ter summari?:en all the e/aN 
uation work {»8timatcH (in person-days) 
by position, for cnrh aapect of thr 
e.v^ij uation. 



PubllcAtlon No. 77.34 



VII. Program Planning Sheets Chapter VII Includes the prograni plans 

which relate program needs to student 
outcomes (Including measurable objectives) » 
classroom processes » Inputs to classrooms, 
staff /program activities, and staff re- 
sources* 
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FINAL REPORT 
Evluatlon Pindingg on ; ESEA Title I Program 

Contact Parson ; Joy Hester or Paula Matusjsek 



Suanary of Evaluation Findings ; 

The ESEA Title I Program In -the Austin Independent School Dlatfict^lf r 
continuing program supported by federal funds ufider the Elementary and 
Secondary Act. The purpose of ESEA .Title I is to provide for the learning 
needs of educationally disadvantaged atudents in school attendance areas 
having high concentrations of children from lov^lncome fanilles. Ik Is 
intended to provide supplemental assistance over and above the regular , 
school program. ^ 

Participation of schools in the Title I Program is determined by economic 
criteria. Schools which have a higher concentration of lov-income families 
than the district average are eligible to receive Title I services. Par£i<* 
cipation of individual students on each campus is determined on the baais ^ 
of educational requirements established for each grade level. 

i 

Twenty-five AISD achooli (flve^dded at nld-year), two non-public schools, 
and four agencies for neglected and delinquent children delivered. services 
to students in 1977-78 through Title I funds. A toUl of $2,663, A46 In 
Title I funds was expanded In 1977-78. 

« 

The chart on the following page gives the characteristics of each component 
delivering services to Title I students in Austin ISD in 1977-78. 

Evaluation of the Title I Program was impienented through an evaluation 
design based on decision questions generated by program staff during special 
meetings with Office of Research and Evaluation staff. Evaluation results 
are presented in terms of these decision questions. 

DECISION. QUESTION 01 : SHOULD TITLE I BE CONTINUED JV AISD WITHL\ THE 

SAME flTRUCTJJRE IN WHICH IT HAS FUNCTIONED IN ^THE PAST? 



Information f rum the following sourcoa should assist adminlfiJaratorB In 
making this decision. * 

Achievement . 

In an effort to acquire better achievement results for T tie I students In 
1977-78, an attempt was made to concentrate the services of Title I personnel 
on fewer students and on thoie students exhibiting the greatest need for 
help. Fewer students were indeed served, but with the exception of 3rt} 
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"component 


tvst 


^MTUOCNTS 
SEHVEO 


SERVICES DELIVERED 


STAFFING 


SCHOOLS SERVED 


Nodal I - Expanded Uh 

. ^Modal II - Pro)#ct VIA 

Hodal III - Individual- 
isH Skills 


11.755. 
087 


K: 920 
Ut*! 939 
2nd: 739 
3rd: 644 
4th: 684 
)th: 619 
Total: 4,545 


Coaponcnt dtaigncd to inprove tht 
reading akiUa of draignated atudenta 
throuKh aiipplementary instruction 
provided hy rending teachers jnd aides. 


Modtl I: 20 tfiachtra, 

tnacruccionai aioWf 
1 aupanriaor. 

Node! II: 15 teachers, 12 
instructional aldca, 1 
aupanriaor. 

Hodal III: 25 taaclara, 

24.5 instructional aidea, 
1 supervisor. 


Hodal I: 81ackahear, Prentwood, 

Sv^M^n WAi*An nBFlfflSfl 

orovn , I'SwacFn, rvcan opi Anp^a ^ 

Pleasant Hill, Milly. Kidgetop* 
Koaedale, St. El»'«, Eavala. 
Nodal II: Ca«phell, Nsplevood, 
Hatheva, Oak Springs, 0/tega, 
Ridgetop*, Rr)newood, Sims, 
riodel III: Allison, Becker, Neti 
Brooke, CovsUe, Norman, Sanchex 


GUID#\yCC AND COirH.SELING 

* 


S252,379 


K: ft64 
Ut: n41 
2nd: 657 
Ird: 623 
4th: 658 
5th: 596 
Total: 4,242 


Component provides counsel ing services 
to students served in the Instructions! 
coisponrot . 


18 counselors, 
1 supervisor 


All schools except those added 
to the Title T Program at mid- 

Brentwood, Beilly, Pecan Springs 


FARFNTAL INVOLV>METfr 


jni>75 


R: 651 
lat: 653 
2nd: 553 
Ird: 484 
4th{ 443 
5th: 461 
Totrtl: 3,245 


Co«v>nnent drslgned to inrrrsse pnrentsl 
support and luprove sttendnncr nf 
chronlrnllv nbsenf Title 1 studnUs. 


15 cosssuntty represents- 
tives 


All schools except those added 
to the Title I Program at mid- 
year (St. Elmo, Plesnsnt Hill, 
Keilly, Brentwood, Pecsn Springs 
and Oswson, Krtr, snd SsnchcR. 


HAPrt TAIJC 




Preschool : 85 


llome-hssed instructional proRrnm 
through use of toys and books demon- 
strsted hy community representatives 
in wecHy visits to homes of psrtlci- 
psntK. 


3 romwunity reprewentn- 
tlves, I prolrct super- 
visor 


Ellgihle children residing In 
Title 1 attendance zones. 

• 


AT H<)Hr. 


$14,000 


K: 149 ( j) 
Utt 181 (92) 
2nd! 137 {91) 
3rd: 147 (88) 
4th: 144 (84) 
Vfh: 148 (88) 
Total! 908 


Home-hnsed instructions! proRCsm 
cnnilncted with children snd their 
pA^**nts throuf.h lessons Mslled Into' 
centr.il office of the At Home Progrsm 
In Mnrylrtnd; lpsrtOn« nrr scored there 
m.il1r<l hark to psrtlc lpnnt?« wltti com 
men t ft. 


None specifically 
funded hy the component; 
progrsm wss mAnsp.ed hy 
reading supervisors and 
SCF. risnnrf 

} 


Brooke, Brown, Campbell, Norman, 

Bldg4^op, Unsertaie, nims, Asvsia 

Idgelop changed from Model T to 
idel Tl at midyear. 
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gradti atudcnts starttd out at vtry 
much the uame level of achievement 
aa atudent« at thoae grade levela in pre- 
vloue years. Third gradera in 1977-78 
etarted out at a lover point than atudenta 
In both prevlout year a i and they were the 
only group to show an increaae from pre- 
teat to postteat in their percentile 
ranking • 

Of 926 kindergartenera aerved in 1977-78, 
272 (29X) acored' above the atated criteria 
for dealgnatlon of atudenta for Title I 
aeryicea (fall 1977 Boehn acorea) • Of 
906 firat gradera, 208 (23Z) acored above 
the cutoff, as did 248 (32Z) aecond graders. 
Percentagea at other grade 4evels ranged 
from IIX to 15%. 



14 



J" 

1 . 

1- 



1 



4 



V 



Becauae the CAT and the Boehm are not 
infallible meaaures of the needs of 
students, schools were allowed the 
option of identifying aa many as 10% of 
their allotted number of students to be 
served even if the students* scores were 
above the criterion cqtoffs. It is obvious 
that this lOX alloi^ance vaa greatly exceeded. 
The effort to oonoentrate Bervioee on fewer 
studente in 197? ^76 wae euaoeaeful^ whereae 
the effort to oonoentrate eervioea on etu^ 
denta with great eat need wae not. 

Even though only partial achievement of 
the goal of concentrating services was 
attained » the Title I Program ahowed 
h tter aohiev^mtent gaina in 1977^78 thcin 
in previoua yeara. The objectives called 
for 1) an average CAT grade equivalent 
gain of .8 months per month of inatruc- 
tton in grades 2-5, 2) an average CAT \ 
grade equivalent score of 1.8 in first. I 
grade, and 3) a raw score gain of nine/ 
points on the Boelim Test o£ Basic Concjbpts. 

The gi^iphs opposite ahow !.hat Title I 
students in kindergarten, third, and 
fifth grades met thelt objectives In 
1977-78; second graders came close to 
meeting their objective. In alt caaes 
the average gain and the penumt w^'i^e/tituj 
the nhjeotive Daa higher* for thin yetiv 
thin ft mn fn, ii^'^tU'?'/. 
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Overlap of Special Program Services 



Title I student Identification flies were merged rtt mid-year 1977-78 with 
Identification files from other major special programs In order to determine 
the number of students served by the various combinations of programs on 
Title i campuses. 

Results showed that • . . 

At mid-year 1977-78 there were 8,449 children in Title I schools; 
4^42? of those students had been served by Title I» and 3,452 were 
being served through the Title VII BlllnRual Program. 

Of the Title I students, 50% were served by the Title I Program and 
no other major compensatory program. 

Only .8% ot the Title I students were served by Title I and tvifo 
other special programs. 

None of the students in Title I schools were served by more than 
three programs. 

Three percent of the Title I students were served by Special Education. 

Nineteen percent of the Special Education students in Title I schools 
were served by Title I. 

Forty-three percent of the Title I students were served by Title VII; 
56X of the Title VII students were served by Title I. This largest 
area of overlap is Illustrated In the figure below. 
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Comparison of these results with the results of a similar study done the 
previous year shows that there waa leaa overlap in apeoial program eervioee 
in 1977^78 s as Illustrated In the following statements. 

In 1976-77 there were 4A5 ijltle I students who were also served by 
two other special programs;! In 1977-78 there were only 34 such 
students. | 

I 

In 1976-77 there were 324 students who were also served through 
Special Education; in 1977-78 there were only 124 such students. 

In 1976-77 there were 2,555 students who participated in the Title VII 
or the SCE bilingual programs; in 1977-78 the Title VII Program "picked 
up" the SCE Bilingual Program students, and It9l8 of the expanded group 
of Title VII students were also served by Title I. 

Management and Paperwork Demands of Title I and Other Special Programs 

Principals, classroom teachers, Title I reading teachers, and counselors 
were asked to estimate the amount of time they spent weekly in paperwork 
for AISD Regular, Title I, and other special programs in their schools. 
Observations of selected principals were also conducted in an effort to 
find out the amount and kind of paperwork and management tasks they are 
required to perform. Four principals were observed on three separate 
occasions from the beginning of their work day to the ending. Principals 
representing each of the following groups were observed: 

1) Title I/Title VII Schools 

2) Title I/Local Bilingual Schools (no Title VII Program) 

3) Title I Only Schools 

4) Non-Title I Schools 

Results of these efforts showed the following for each group from whom 
information was solicited. 

Classroom Teachers : One-fifth of the classroom teachers indicated on 
questionnaires that they spent no time at all on paperwork for Title I, 
and nearly one-half spent less than 30 minutes weekly on such paperwork. 

A thl» d of the classroom teachers spent no time at all on Title VII paper- 
work, and 23% spent less than 30 minutes weekly on such tasks. 

Special Education appeared to require very little or nothing in the wa: 
paperwork from classroom teachers in most cases; however, 18% did report 
spending more than two hours a week on Special Education paperwork. 

T itle I Read Ing^ Teachers : Title I reading teachers spent little time in 
paperwork for programs other than Title I, according to their questionnaire 
responses. Thirty-nine percent reported spending either no time at all or 
less than 30 minutes weekly on paperwork for the Title 1 Program. 

Counselors: According to their responses, 19" of the counselors spent 1^2 
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houra daily on paperwork for Title I, and a further 19% spent more than 
two hours dally on such tasks. 

Only 7% of the Title I clerical aides spent more than two hours daily 
assisting the counselor with Title I paperwork, according to counselors, 
while a further 7X did spend 1-2 houra daily in assisting thea. 

It appears that counselors spent more time in paperwork for Title I and 
for AISD Regular than they did for Special Education and other special 
programs in their schools. It also appears that as a group they received 
little assistance with paperwork from the Title I clerical aides. 

Although 63X of counselors reported spending one hour or less on Title I 
paperwork daily, and 87;!: spent an hour or less daily- on Special Education 
paperwork, the aombination of Bouraea requesting paperwork of aounaelore 
indiaatea that the amount of paperwork performed by aouneelora va rnordtmte. 

Principals : There was no consistent pattern in the amount of paperwork that 
principals indicated they had to do for various programs. Special Ed was 
the most demanding program in terms of paperwork on two campuses, but was 
the least demanding on another. Title I was the least demanding on two 
other campuses. The amount of time spent on Title I paperwork ranged from 
0-57, weekly on three campuses to 50% on one campus. 

The variation from campus to campus would seem to depend upon the management 
system employed by the principal and the resources available. Three princi- 
pals clteH the clerical aides and other new personnel this year as the 
reason for less Title I paperwork for the principals. On campuses where a 
fulltime counselor was not available, principals usually spent more time 
in paperwork for Special Education. 

Several principals stated that management of people is the time-consuming 
factor related to Title I and ot,her special programs, rather than paperwork t 
demands. I 

Day-long observations of the selepted principals showed that . . . 

1-2% of the day for Title I principals was devoted to Title I 
paperwork. 

2% of the Title l/Title VII principal's day was taken up by Title VII 
paperwork. 

None of the Title I principals spent any time in paperwork for 
Special Education, while the non-Title I principal spent 1% of his 
day in Special Ed paperwork. 

Principals of the Title I schools with bilingual programs spent more 
time in meetings with AISD administrative personnel. 

The principal of the Title l/Tltle VII school spent considerably more 
time with Title I campus staff than fiid the other two Title I 



IX. b 



principals. Very little principal time waa spent with bilingual 
program personnel on the two campuses with bilingual programs. 

Principals of Title I schools with bilingual programs -spent half as 
much time with students than was spent by the other two principals. 

The Title l/Tltle VII principal consistently worked longer days than 
did the other three principals, and the Title l/Local Bilingual 
principal ranked second In terms of most hours worked. , 

The findings related to amount of time spent In paperwork are consistent 
with principal statements during Interviews that the actual paperwork 
aaaociated with special programs was not burdensome. The management of 
personnel and coordination of the programs were perceived by them to be 
far more demanding. Observation results^ however^ did not show much 
campus time spent on special program management tasks^ though meetings or 
Interviewing activities off campus did take large amounts of time when 
they occurred. 



DECISION QUESTION #2 ; SHOULD TITLE I CONTINUE TO SERVE THE SAME SCHOOLS 

THAT WERE SERVED IN l9??-?d? 

The Systenwlde Evaluation unit of the Office of Research and Evaluation 
analysed 1977-78 CAT scores for Title I schools as a group and non-Title I 
schools as a group. Median percentiles for each grade level Indicate that, 
with the exception of Blacks In first and fourth grades, all ethnic groups 
In non-Title I schools scored higher than corresponding groups In Title I 
schools. 

^ The overlap Information discussed under Decision Question #1 Is also 

relevant in the present case and should be consulted. 



DECISION QUESTION #3 ; BW SHOULD TITLE I ACTIVITIES BE COORDINATED WITH 

THOSE OF OTHER FEDERAL^ STj^TE^ AND LOCAL PROGRAMS? 

The evaluation department ^t Texas Education Agency wa9^ asked Informally 
by the Title I Evaluator In the spring of 1978 to Idientlfy exemplary districts 
where coordination of federal, state, and local programs was functioning 
at a level worthy of emulation or study by AISD. Response from TEA Indi- 
cated that although several districts have made good progress In this 
direction, none would be considered exemplary. It was suggested that visits 
to these districts would be most effective If they were conducted by special 
prograirt personnel, AISD Regular personnel, ; id evaluation personnel together. 

In order to determine the amount of coordination presently taking place 
between Title I and other programs In AISD, the following groups were asked 
to respond to questions about coordination, 

Progrn n' Coordinators : Five evaluations cf^ntbiriCa Ui:ilr efforts for one 
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spring stiff survey to all persons In coordinator/supervisor positions In 
the five programs, plus the Department of Elementary Education. Study of 
.^the responses to the survey revealed the following about the coordination 
of special programs In AISD« 

The Bilingual Education Task Force meets monthly and brings Jp«ether- 
supervisors and coordinators from both the Title VII and the State/ 
Local Bilingual Programs, with some personnel from Title Regular 
and the Department of Elementary Education. 

The First Friday meetings held monthly by the Department of 
Elementary Education are Irregularly attends! by personnel from 
Title I, Title VII Bilingual, and the State/Local Bilingual Programs* 

Within departments, program staffs meet regularly with each other. 
The biweekly Department of Developmental Programs staff meeting 
Involved personnel from the Stata^ Compensatory Education, the Title I, 
and the Migrant programs. 

Title I summer school planning Involved a couple of coordinators from 
the Departinent of Elementary Education. 

Development of an early childhood program for the district has 
involved personnel from Title I Regular and Migrant and the Depart- 
ment of Elementary Education. 

Coordination other than meetings and conferences occurs through 
copies of memoranda. Joint staff development activities, and working 
on smaller projects at the ccnDus level. 

Comments about the need for more communication and coordination were 
frequent. 

Classroom Teachers/Title T Reading Teachers ; Teacher questionnaire responses 
indicated that coordination between Title I and the regula: AISD program 
was fairly high. There was considerably less coordination between Tltlo I 
. and Title VII, though, according to teachers, with 42% saying that there 
was very little or no coordination in evidence between the two programs. 

Title I reading teachers were even more positive than classroom teachers 

in their perceptions of the coordination between Title I and other programs. 

Counselors : Nearly half of the counselors felt there was much coordination 
between Title I and the ret;ular AISD program, according to their question- 
naire responses, but very few felt there was much coordination between 
Title I and Title VII. Coordination between Title I and other special 
programs appeared to be more in evidence to counselors than Title I - 
Title VII coordination. 

Principals ! Coordination problems continued to exist for most principals, 
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Including those principals who felt that coordination between Title I if^ 
and AISD Regular had Improved. Problems with coordination of the bilingual 
programs with Title I and with the regular AISD instructional program were 
most often mentioned. 

It ia obvious that although aoordination batween Title I and AISD Regulccp 
has inoveased, there ia otill room for improvetprnt^. It ie even more 
obvious that coordination between Title VII Titl\I, and between Title VII 
and AISD Regular, ia in need of improvement^ \._ 

DECISION QUESTION U : SHOULD ANY OF THE THREE INSTRUCTIONAL WDELS 

EMPLOYED IN l9?7-?8 ^^E CONTINUED^^l^^PANDED^ OR 
REVISED? 

Information In the following areas should assist decision-makers with 
this question. 

Instructional Time 

Day-long observations of randomly selected Title I students, non-Title I 
students in Title I schools, and non-Title I school students were con- 
ducted throughout the year in 1976-77 and again in .1977-78. Study of 
these observation results shows the following* 

Students in each of the three models received a little over 3*i 
hours of instruction daily in the basic skills/major content areas. 
There were some differences between the models by grade, level, but 
■these grade level differences cancelled eYch other out, and the 

vcQulta for each model differed by only 1^2 mimtea. 

Time spent in reading/language arts was the same for each model, 
with each spending two hours and 23-2A minutes in those activities* 

Schools in each of the three models delivered more time in reading/ 
language arts to their Title I students than students in rton-Title I 
schools received. 

Achievement 

All models made comparable gain<4 on the California Achievement Test at 
every grade level. 

DECISION QUESTION //5 : SHOULD A CLEARER CURRICULAR APPROACH BE ADOPTED FOR 

THE EXPANDED LAB MODEL (I) AND THE INDIVIDUALIZED 
SKILLS MODEL (III>? 

Obeervatiohs 

Observation results showed that . . . 

Model II (Project VIA) students used more audiovisual materials and 
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fewer books other than text books than did students in Model I 
(Expanded Lab) and Model III (Individualized Skills) . 



Students In Model III used fewer texts and more books other than 
textbooks than did students in the other models. 

There was very little difference between the three models in terms 
of materials usage in all other categories. 

The uae of mt^re audiovisual materials by students observed in Model II 
schools is consistent with the Model II curriculum, which calls for use 
of special a-v equipment. The use of fewer books other than textbooks in 
this model is also consistent with the structured curriculum of the 
Psycho technics Program being implemented in Model II, 

Classroom Teachers/Title I Reading Teachers 

When asked to indicate the curricular systems they used with their students, 
one-third of Title I reading teachers indicated that they used the Psych- 
technics Program. It can safely be assume! that one-third makes up the 
one-third of Title I reading teachers who are assigned to Project VIA 
schools, since the Psychotechnics Program was brought to AISD this year by 
Title T specifically for Project VIA. Making the same assumption for 
classroom teachers (that is, if they indicated use of the Psychotechnics 
Program, they were in Project VIA schools), it can be said that the Psycho- 
technics Program was fairly extensively used in the Project VIA model. 

Generally there was much variation in the curricular systems used within 
Title I reading teachers as a group and within classroom teachers as a 
group. There was also much variation between the two groups. 

DE CISION QUESTION //6 : SHOULD SPECIAL PROCEDURES BE ADOPTED TO DEAL WITH 

CHTLDREN WHO TRANSFER FROM ONE MODEL TO ANOTHER 
DURING THE SCHOOL YEAR? 

Classroom Teachers/Title I Reading Teachers/ Title I Aides 

Title I instructional persontiel were asked to indicate on nine week reports 
all student transfers into and out of their schools. Study of these records 
showed that only 20 Title I students transferred from one model to another 
during thv school year. Twenty-one other students transferred from one 
school to another wivhin the same model. 

Twenty-two percent of classroom teachers indicated in questionnaire 
responses that there had been at least a few problems experienced in working 
with Title I students who had transferred into their schools from a school 
In one of the other two models, and 39% of Title I reading teachers had 
rxpuric'uced problems of this nature, 

Th i r ty-rljr;ht percent of classroom teachers, and 20% of Title I teachers had 
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had no cransfer students from other Title I models. 

Shev^i 'Muld -Tppe^ir to be no need for special procedures to deal with 
tranafer jvudenta from one model to another during the year. 

DECISION QUESTION tH x SHOULD TITLE I CONTINUE THE CONCENTRATION OF 

SERVICES ON A SMALLER NUMBER OF STUDENTS THAN "AD 
SEEN SERVED PREVIOUS TO l$?7'7e? 

The achievement information reported under Decision Question ifl and the 
overlap information under that same question are relevant to this question. 
Other major sources of information which relate to this question are the 
nine week reports completed by Title I instructional personnel at the end 
of each nine week period and the observation data. 

Nine Week Reports ; School personnel identified 6,330 students for service 
in 1976-77 and served 5,433 of those students by the end of the third nine 
week period. In the following year, 4,998 students were identified, and 
3,623 were served. Title I definitely concentrated its services on fewer 
3fudenv3 in 1377-73, 

Most campuses were able to serve over 90% of their identified students by 
the end of the third nine week petiod in 1977-78, and most were able to 
provide reading Instruction by a Title I reading teacher to at least 60% of 
their students. Over 70% of all identified students were served by a Title I 
reading teacher at some time during the year. A litule over 30% were served 
dflily throughout the year. 

Obsei 'j I ions ; Comparison ot otdervation results for 1977-78 with 197b-77 
shows iriat Title I students received more tine daily in basic skill s/ma-j or 
content -zrea instruction in 1077^7 3. However ^ Kon^T^tle I students in 
7itle I schools and students in non-Tizle I schools also received more 
instvxction in these areas in 1277'7S. 

Substantia', increases in time spent in reading/language arts were shown for 
at: groups in 1377-78, while slight increases in time spent in math were 
also shown. Mo mora time was spent in science by any of the groups, but 
increases in time spent in social studies were shown. 

Decreases in 1977-78 were shown fo.. ail groups in activities coded under 
Other (school assemblies, fairs, field trips, etc.) and activities coded^ 
33 Management/Miscellaneous (the category called No Instruction in 1976-77). 

The pie graphs shown below display the percentages of time spent in each 
area by all three groups. 

Comparison of obser/ation results for students who went to a mding lab 
with those students who did not go to a reading lab shows tnat reading lab 
students received more time in reading/ language arts than did students who 
did not attend a reading lab. This indicates that the reading scr^jices 
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offered by Tizle I are supplemental to the regular reading pvogvam in 
that vhey are generally in addition to the regular reading instruction 
received by the jtudentj. 
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DECISION QUKSTIQN //8 ; iHIOUU) THE ACTIVITIES OF THE VARIOUS TITLE I SUPPORT 

COMPONENTS HE CONTINUED AS THEY ARE, OH SHOULD THEY 
BE MODIFIED? 



Guld^ince and Counvseling Component 

Ninety percent of all identified Title I students were served in some way 
by a counselor by the end of March. Thirty-eight percent were individually 
counseled, and 88% were group counseled. 

In the fill of 1977 a random sample of students in Title I schools was rated 
by their classroom teachers on a behavior rating checklist. In the spring 
of 1978 the teachers again rated these students. The objective for the 
component called for 60% of the students to demonstrate an increase in 
acceptable classroom behavior, as measured by teacher ratings on this 
behavior rating checklist. At no grade level was the objective met. How- 
ever, more of the students who were individually and group counseled 
showed Improvement than students who wp-re only group counseled. 

Parental Involvement Component 

Sixty-live percent of all Title I students in AISD were served by a Title I 
community representative by the end of the third nine week period. The 
homes of 36% of those students had been visited, and parent contact of some 
kind had been made for 55%. 

In the fall of 1977 the evaluation staff checked school attendance registers 
In order to determine the students on each campus who had been absent from 
school 1?. days or more in 1976-77. Lists of these students were sent to 
the community representatives so that they could concentrate on Improving 
the attendance of these students in order to meet the objective that 60% 
of the designated low attenders (with whom the community representative 
worked) would demonstrate improved attendance in 1977-78. A check of the 
students* attendance records for 1977-78 showed that the objective was met. 

However, of the students who were designated to coimunity representatives 
as low ;it tenders, community representatives only worked with 565 In some 
way. Fi)uv hioulr^i'd fovty-fouv low atteruievB Were not eewed in any way by 
ii Ti t Ir r * 'onmn i hj rcpvcscn tu lion . 

At Home Pro gram 

A total of 884 students was initially enrolled by the schools for partici- 
pation In the At Home Program, but only 570 students completed the program. 
One hundred flfty*three partially completed the program. Some students who 
partictpated In the At Home Program did not receive service through the 
Title I Instructional component, as is required for students served in 
support components. 

Ohieetlvos set for the At Home Program were based on the same measures as 
the object Ives for the Re^adlng Componenc. However, objectives for the At 
Home Prograin were set slightly higher, since these Hf udents were to receive 
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service through the regular Title I reading component and through the 

At Home Program, Par* tufi pants met theep- ohjecytivea at the fivat^ tJiird^ 

(irul fifth [jY\iiU'.a, KinUiVfjav timers acmia very &lo8e to meeting their objective* 

Happy Talk 

Approximately 20 weekly lessons weie presented by Happy Talk community 
representatives in the homes of participants. Pretest and posttest 
measures administered by Title I Evaluation to participanto and a control 
group showed that the achievement of children in the treatment group^ 
comiHm.:(l ; ) those in the control groups did not differ significantly . 

It is possible that several problem areas could have accounted for the 
absence of significant group differences. First, a two month delay in 
program activities reduced the actual number of lessons received by the 
treatment group. Second, the use of a possibly unreliable measure of 
student achievement, i.e., the Spanish translation of the Peabody Picture 
Vocabulary Test* could function to obscure program effects* And lastly, 
parent questionnaire responses indicate that some did not spend much time 
working with their children using the concepts demonstrated by the Happy 
Talk community representatives. 
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(Technical Report) 



ABSTRACT 



Title: ESEA Title I Project 1977-78 Final Technical Report 



Contact Person: Joy Hester, Paula Matnszek, Ph.D. 



No. Pages : 774 



Suflnnary : 

This report documents the purpose, procedures, and results for each Informa- 
tion source used by Title I Evaluation In 1977-78. It contains 24 appendices, 
each of which Is devoted to a single Instrument or Information source. 



Each appendix contains: 

An Instrument description 

Purpose for administering or accessing the Instrument /source 

Procedures used to collect the data 

Results 

Figures presenting the data 
The technical report for 1977-78 contains the following appendices: 



Appendix A 
Appendix B 
Appendix C 
Appendix D 
Appendix E 
Appendix F 
Appendix G 
Appendix H 
Appendix I 
Appendix J 
Appendix K 
Appendix L 
Appendix M 
Appendix N 
Appendix 0 
Appendix P 
Appendix Q 
Appendix R 
Appendix S 
Appendix T 
Appendix U 
Appendix V 
Apptudlx W 
Appendix X 



California Achievement Test 

Boehm Test of Basic Concepts 

Pupil Activities Record 

Classroom Observation Reaction Form 

Behavior Rating Checklist 

Nine Week Reports 

Attendance Data 

Peabody Picture Vocabulary Test 
Iowa Test of Preschool Development 
Cloze Vocabulary Test 

Summer School Attitude Toward School Measure 
Summer School Attendance 
Staff Survey 

Records/Schedules of Component Supervisors 

Parent Questionnaire 

Happy Talk Pareat Questionnaire 

Classroom Teacher/Title I Teacher/Title I Aide Questionnaire 

District PAC Records 

Counselor Questionnaire 

Principal Interview 

PAC Off . r Interview 

Happy Tl Supervisor Interview 

Happy Talk Conmunlty Representative Interview 

Principal Observation.^ 
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Publication No, 77.31 
(Interim Report) 



ABSTRACT 



Title: Needs Assessment for the Preparation of 1977-78 Applications for 
Compensatory Education Programs 



Contact Person; Paula Matuszek, Joy Hester, David Doss, Patsy Totusek 



No> Pages ; 722 



Summary : 



The seventeen sections in r.hls needs assessment are; 



I. Introduction . A rationale for needs assessment is accompanied by a 
brief overview of the nature of this publication. 

II. School Characteristics: Enrollment, percent attendance, percent low 
income, and ethnic distribution are given for the past five years for 
all \.I.S.D. schools. 

Ill, Study of School Costs . Grant costs and other information relevant 
to the question of distribution of resources among schools is given. 
This information was prepared by the Department of Finance for pre- 
sentation to the Board of Trustees. It is included in this report 
in order to make it more accessible to planners. 

IV. Family Survey > Low SES and Minority Student Achievement Study . A 
survey of a sample of families in Austin that had either second or 
fifth grade students attending Austin schools was undertaken by the 
Low SES and Minority Studflnt Achievement Study in 1977. Some of the 
preliminary results of this survey are included here. ThesL results 
show by ethnicity .... 



1 

3 
4 
5 
6 
7 
8 
9 

10 
11 



Percent of Male Head oC Houstihold Working 
Percent of Female Head of Household Working 
Level of Education of Male Head of Household 
Level of Education of Female Head of Household 
Percentage of Students Having Preschool or Daycav". 
Percentage of Students Attending Kindergarten 
Percentage of Students Attending AISD Kindergarten 
Percentage of Students Changing Schools in the Past Year 
Number of Different Schools that Student Has Attended 
Parents' Rating of How Student is Doing in School 
Parents' Ratings of the School that the Student Attended 




7'V.. 



Publication No. 77.31 



12) Amount of Education Parent Would Like :.o See Student Get 

13) Yearly Family Income 

V. Literature Reviews. Because it Is always important before embarking 
on new educational endeavors to see what results have been recorded 
for similar endeavors in other situations, the following areas of 
Interest are summarized in literature reviews. 

1) Sibling Tutoring 

2) Parental Involvement and Sixth Graders 

3) Summer School for Low SES Students 

4) Math Programs for Low SES and Minority Students 

[V. Language Dominance Information. Information in the following categories 
i3 given by grade level and school for all K-5 Elementary campuses. 



1) Number of English dominant children 

2) Number of Spanish dominant children 

3) Number of bilingual children 

4) Number of children for whom more information is needed 

5) Number of children for whom both scores were low 



VI £ . Overlap Study: The Number of Students Served by Multiple Programs . 

An ongoing concern of personnel involved with special programs has 
been the overlap of services being provided to some students. In 
an effort to document the extent of this overlap, ORE conducted an 
overlap study in 1976-77 which defined the groups of students being 
served by each of the many possible combinations of special programs. 
The results of that study were sufficiently enlightening to encourage 
a repetition of that effort in 1977-78 in order to determine the .amount 
of overlap that might continue to exist. The results of the recent 
study are included here. 



VIII. Achievement Levels ; This section summarizes the scores obtained by 
A.i.S.D. students on four tests: 

1. ) Boehm Test of Jasic Concepts 

2. ) Metropolitan Readiness Test 

3. ) California Achievement Test 

4. ) Sequential Tests of Education Progress 



IX. Title I Summer School. A comprehensive review of the results of the 
evaluation pt Title I summer school is reviewed here. This information 
should prove useful to planners of summer school in general and Title I 
summer school In particular. 
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X. Title I Parent Questioonaire . A short questionnaire was mailed to 
a sample of parents of Title I students in October of 1977. This 
chapter outlines their respones. 
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:CI* Iden .if icaclon of Titla I Studenca , Procedures and cricaria for 

Idtnciiylng Ticla I scudencs are ouclined, and a scudy of che lists 
Is discussed* This scudy ihcvs che percentage of students on 
each casxpus vho vere identified by test score and chose who were 
Identified by school recommendation. It also prints out the 
percentages of students vho vera identified for services even 
chough cheir test scores vere higher than che scores stated in 
che criteria, as veil as che percentages of students vho vere aot 
identified :or servici^s even though cheir scores vere low enough 
CO autotnatically qualify chem for ser^/ices. The percentages of 
students vichout any test scores at all are also aoted. 



II. Tide I ^fi^e Veek Reports . Mine veek report corns are completed by 
che ride I counselor, communlcy representative , and instructional 
per3onnp\ on each Title I campus. Tvo types of summaries of the 
these reports for che first nine veek period are included here: 

L) A general summary for each campus vtiich shove che number and 
percentage of students aerred by Tiile I instructional 
personnel, che community representative, and che counselor. 

I) Detailed school summaries for counselors and community 

representatives vhich shov che activities chat are included 
unaer che Larger categories in che general summary. 

Separate chapters iddress che following areas of che Migrant Program in 

mi. Austin's Migrant Students: Vhere They Attend School. 

Xr7, Austin's Migrant Students: 'Jhac Is The Entry Achievement Level 
of cha ?re-Kindargarten Scudents? 

r/, Austin ^3 Migrant Students: Ac What Level Are They Achieving? 

VIZ. Austin's Migrant Students: Vhat are Thair Healch Needs? 

:cni* Austin's Migrant Students: What Other Supplementary Programs Are 
Serving Them? 
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ABSTRACT 



Title; Title I at the End of the Year 1976-77 

Contact Person: Joy Hester, Paula Matuszek, Ph,D, 
No, Pages : 12 

Suimnary ; This brochure summarizes information contained in the end-of- 
year evaluation report for the 1976-77 Title I Program in Austin ISD. 



School Characteristics: 



Questionnaires administered to teachers in Title I schools revealed that 
5SZ of the teachers have fovxtal training beyond a bachelor's degree. 
Responses to the questionnaire further revealed that 33% of teachers in 
Title I schools had eight or more years of teaching experience in low-income 
schools, 8% were in their first year of teaching, and 20% were in their 
first year of teaching in a Title I school. 



The chart 'below gives the major characteristers for the past five years of 
the present 20 Title I schools. 



OVERALL TITLE I SCHOOL CHARACTERISTICS 
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General Description of Title I Program 

Austin's Title I Program was designed to provide special services to low 
achieving students. Supplemental reading Instruction was provided to 
identified Title I students In 20 Austin public schools, two non-public 
schools, and one agency for neglected and delinquent children. 

Eighty-seven percent of the 6,230 students identified for Title I 
services were served by Title I instructional personnel in some way. 
A study showed the amount of direct instructional time provided to Title I 
students by Title I personnel varied from none to several hours per week. 
On the average, a Title I student received about seven minutes a day of 
direct instruction from Title I personnel. 

Two other areas of Austin's Title I Program were counseling and guidance 
and parental involvement. Fifteen of the twenty schools had Tltr.e I 
counselors who worked with students individually or in groups. Thirteen 
of those same twenty schools had Title I community representatives who 
worked with the parents of Title I students. Improved attendance for 
Title I students was a major focus of their., actlvlules, along with effects 
to involve parents of Title I students in school activities • 

A parent advisory committee made up of parents of Title I students met 
regularly to review the progress of the Title I program and to provide 
input in the planning and conducting of program activities. 

Evaluation Findings about Reading 

There^'was no common approach to reading being used in the Title I schools 
or in the Title I reading labs. 

Through classroom observations^ school visits, and discussions with school 
personnel, descriptions of individual school programs were developed. 
Evident in these school program descriptions was a common theme: most 
classroom teachers and most Title I reading personnel were choslng their 
own approach to reading instruction rather than coordinating their 
approach with teachers within their school or other schools. 

Evaluation Findings about Guidance and Counseling 

Each teacher in a Title I school rated the classroom behavior of a group 
of randomly selected students in the fall and again in the spring, using 
a locally developed behai^lor rating checklist. 

According to the teacher ratings, more of the students who received 
counseling services improved in their bphavlor than did students who 
did not receive counseling services. 
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Kvaluation Findings about Parental Involvement 

Fifty-six percent of those students whose homes were visited and/or whose 
parents had received telephone calls from the conununity representative 
Improved their attendance. However, this figure fell short of the 60% 
called for In the objective set for that component. 
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ABSTRACT 



Title : How Time Is Used In Title I, A Sample oc Non-Tirle T, and Sixth 
Grade Schools. 



tontact Person; Joy Hester and Paula Matuszek, Ph.D. 

u 

No, Pag es; 9 
Sunnnary ; 

A total of 227 day-long observations wert conducted by the Office of 
Research and Evaluation during the 1976-77 school year a^a part of the 
evaluations of Title 1 and State Compensatory Educa,tion, ' This procedure 
yielded 1,A75 hours of observations and provided a picture of ho vr time 
in the school day is used in. the Title I schools, sixth grade schools, 
and a sample of non-Title I schools. Information relevant to group size, 
arubunt of verbal instruction received (adult contact), and materials 
used was also gathered. 



Five graupja^of scudents werWftiuerveci : 



Title I students ^ gfll 

Non-Title I students in Title I schoJls 
Students in non-Ti-tle I schools 
SCE students (State Compensatory Education) 
I|lon-SCE' students 

Observation results are presented in a series of pie grnphs such as the 
one shown for Title I students. 

Tini I siutifis 
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ABSTRACT 



Title: Achievement Test Profiles <,Title 1) 



Contart ^^^!«on: Joy Hester 



No. Pages ; 210 

Summary ; The information in this report was originally prepared is 
information for principals and school staffs to use in setting school 
goals. Each school rei^eived Ics own school data. This 77-78 report 
summarizes the data fei all Title I schools. 



Graphic representations such as those shown below are included for the 
following; 

California Achievement Test median percentiles (for each of 
the three major Title I components) for April, 1977, and 
April, 1978, for grades 2-5. Projectwide medians as well 
as individual school scores are provided. 

Boehm Test of Basic Concepts (Total Score) for September, 1977, 
and February, 1978, for kindergarteners projectwide and by 
individual school. 
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ABSTRACT 

Title ; ESEA Title I Program (1977 - 78) Evaluation Design 

Contact Person: Paula Matuszek^ Ph,D», Joy Hester 

No. Pages ; 29 

Content : 

The evaluat^)-! design is a one-year plan of evaluation work for the 
project. TUl' 'i.Vble of contents for this document includes: 



I. Evaluation 0.\*v.jn Review Form 



L[. Doc ii-^ ion Questions 

A. Questions Addressed 

B. Overview 



in. Narrative Summary 

A. Program Summary 

B. Evaluation Summary 

IV. Information Sources Summary 



V. Summary of Data to be 
Collected in the Schools 

VT. Evaluation Time Resources 
Allocation Summary 



This chapter presents the names of 
persons responsible for some aspect 
of the project's implementation who 
have been provided relevant portions 
of the design for review and comment. 

Here the evaluator states all the 
decision questions and relates them 
to evaluation questions, objectives, 
and data sources. 

This chapter briefly describes the 
project and the evaluation activities 
tied to the project. 

Each data source is listed, and the 
evaluation questions which the source 
references are listed. The dates of 
data collection and the analysis 
techniques to be employed are also 
given for each source. 

This is a timeline for the collection 
of data in the schools. 



This chapter gives estimates of the 
number of person days required from 
each staff parson for completion of 
all activities related to each data 
source. 



Eva luat i on Design Summary : 

t'vaLuation of the Title I Program In Austin serves two main purposes: 
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, To provide information to the local decision-makers responsible 
for the Implementation of the project's activities, 

• To provide information required by the Texas Education agency 
on the progress of students being served* 

For each of these purposes a major report will be prepared toward the end 
of the project year. The staff hired to accomplish this task consists of 
a senior evaluator (45% of her time alloted to Title I, the remainder to 
other compensatory programs), an evaluator (100%), two evaluation assistants 
for process evaluation (100%) , one evaluation assistant for data processing 
(90%), witjx the remainder of lis time funded by Title I Migrant, a data 
analyst (7k), with the. remainder of her time funded by Title I Migrant, a 
secretary (100%), and an evaluation intern (50%). This division of labor 
allows for the necessary coordination of activities and ideas within the 
evaluations of the compensatory education programs in the District* 

On-going evaluation through classroom observations, interviews, questionnaires, 
and monitoring of records, documents the level of implementation of project 
activities. Outcome evaluation through standardized and locally developed 
Instruments measures the student outcomes produced by these activities. 

Other major i;-esponsibilitles of the evaluation staff include the conducting 

of required needs assessments, the collection of demographic data on 

schools and students, the measurement of project objectives, and the 
management ot the following surveys. 

1) Nine week reporting of services provided. 

2) Spring economic and educational needs surveys. 

3) Fall identification of Title I students. 

Decision questions afe identified at both a system-wide and a project 
level.' These are then associated with evaluation questions, the answers 
to which will contribute to the answering of the decision question* 
Lastly, the scheduling, collection, analysis, and reporting of this infor- 
mation is outlined in terms of the school personnel affected, the time 
required of evaluation, and the dates for completion of Information 
gathering and reporting activities. 



Scope of Design: 



10 Decision questions (Levels: System and Program) 
58 Evaluation question 



Evaluation Resources Required (in person-days): 



54 

230 



760 



178.5 



Coordinator 
Senior Evaluator 
Evaluator 
Data Analyst 

Evaluation Assistants and Evaluation Intern 
Secretary 




FINAL REPO RT 
Evaluation Flndinj^a on: Title I Migrant 



Contact Person: David Doss, Paula Matuszek 



Summary of Evaluation Findings : 

The following Is a summary of evaluation findings about the Migrant 
Program for 1977-1978. Only the most significant findings are reported 
here. For more Information see the other documents described In this 
section of this Evaluation Findings volume. 

The Migrant Program In Austin Is a program which offers Instructional 
and support services to Austin's migrant students. The Migrant Program 
was funded for 1977-78 at approximately $500,000. To be eligible for 
services students must meet the definition of a currently migratory or 
formerly migratory child. A currently migratory child Is one whose 
parents or guardian la. a migratory agricultural worker or migratory 
fisherman, and who has within the last twelve months moved from one 
school district to another In order to enable the child, the child ^s 
guardian, or a member of the child's Immediate family to obtain temporary 
or seasonal employment In an agricultural or fishing activity. A formerly 
migratory child is one who has not migrated during the laflt year, but 
who did migrate within the last five years. 

By May 1, 1978, the District had registered about 1100 eligible students, 
about 65% of whom were currently migratory students. They were enrolled 
In 55 District schools and three parochial schools; however, about 
62% attended ten schools in east and south Austin. 

Analyses of the migrant students' scores on the Boehm Test of Basic 
Concepts, the Metropolitan ReadineF ; Test^ (MRT? , the California Achievement 
Tests (CAT), and the Sequential Tests of Educational Progress (STEP) 
show that at most grade levels the migrant students as a group score 
well below the national average. (See the figures on the following page.) 
In addition many migrant students come from low income families that 
have limited resources for purchasing clothing and medical care. In 
an attempt to meet these needs, the Migrant Program developed both 
Instructltmal and support components. 



T he instructional Components 

Because the migrant students In Austin attend ho many different schools. 
It Is not economically feasible to serve all ot them with an instructional 
program. Only those schools with a sufficiently large concentration of 
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migrant aCudenCs have a Migrant 
teacher on the campus. In the other 
schools, those migrant students with 
a need for instructional support are 
supposed to be served by another of 
the compensatory education programs 
In the District such as Title I 
Regular, the State Compensatory 
Education Program, or the ESAA Basic 
Program. In January, 1978, 50% of 
the migrant students registered at 
that time were not being served by a 
Migrant teacher. Of that number 
about 33% were being served by another 
compensatory program which meant that 
about 23% of the migrant students were 
not receiving supplemental instruc- 
tion. Some overlap occurred between 
programs. Of the 77 A students served 
by the Migrant Program or another 
supplemental program, 235 or about 
30% were served by more than one. 

The 1977-78 Migrant Program had 
three Instructional components: 
a Pre-klndergarten Component for four-year-olds, an Oral/Wrltten 
Communication Component for students in kindergarten through the fifth 
grade, and an Oral Language Development Component for. students In 
grades six through twelve. 



P re-klndergarten Component 

The Pre-klndergarten Component provided full-day, pre-klndergarten classes 
for four-year-old migrant students at six sites. All of the teachers 
were bilingual and in most cases so were their aides. The curriculum 
used In the classes was the Bilingual Early Childhood Program (BECP) 
developed by the Southwest Educational Development Laboi^atory. 

The evaluation findings for 1977-78 show the Pre-k Component to have been 
the most successful of the instructional components. A series of seven, 
day-long, observations were done in each pre-k classroom. The observations 
showed that the students spent on the average about 150 minutes or about 
two thirds of the time they were not eating or napping in instructional 
activities. About 50 minutes or one third of their Instructional time 
was spent in BECP activities. About 75% of the instructional time was 
structured; i.e., the activity showed evidence of rules set down by the 
teacher or aide, either at that time or at some earlier time. The 
predominant language of Instruction was English. Spanish was used only 
about AO minutes per day or about 22% of the time language was recorded, 
tt would appear that students who were Spanish dominant, however, 
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received (Considerably more of their instruction in Spanish than the 
averaji;c^ K^ven above. This was eHpecially true when the students were 
grouped by Lan>;uaKe dominance for small group Instruction. It would 
appear I rom these findings that the pre-k teachers were not "short 
ehanginK" their students in Spanisl\ instruction, but rather were teaching 
primarily In English because they felt it to be the most appropriate 
language fur most of their students. 

In addition to i)bservation data, tlie evaluation of the Pre-k Component 
examined two sources of achievement data. The first was the results 
of the mastery testing done as part of the BECP. Each eight to ten 
units of the BECP has a mastery test designed to measure mastery of the 
concepts taught by the units. The teachers had time to give two of 
the three tests by the end of the year, j 

T\w results in figures below show a high level of mastery on each test. 
The students exceeded the objective set by the program in applying for 
funding to the Texas Education Agency, 
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In addition, the migrant pre-k 
students and the four-year-olds at 
tht^ Rosewood-Zaragosa Day Care 
Center were given the General 
Concepts Test of the Tests of Basic 
Experiences series. The two groups 
did not differ on the pretest; 
however, by the posttest, the 
migrant students had clearly out- 
gained the Rosewood-Zaragosa stu- 
dents. The reasons for the dif- 
ferences In gains are not clear 
since the experiences of the two 
groups differed in a number of 
ways. It is clear, though, that 
the Migrant Program pre-k classes 
produced greater gains than did the 
Rosewt»od-Zaragosa Day Care Center. 
Overall, the migrant students 
achieved about a year's growth in 
six months. The figure to the 
right shows the median and range 
of total score for migrant students 
on the pretest ancj posttest admin- 
istrations of the TOBE. 
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It was also found in analyzing the 
TOBE results that statistically 
significant class-to-class differ- 
ences existed within the Migrant 
Program. Again, it is not clear why the differences occurred; however, 
a preliminary '•eyeballing" of the observation data with the TOBE results 
in mind showed that those :!lasses that spent more time in BECP activities 
and in structured activities appeared to make larger gairs on the TOBE* 
Moreover, those classes that spent more time without the direct super- 
vision of an adult made smaller achievement gains. on the tes\% 



Interviews of the pre-k teachers revealed that they are generally pleased 
with the BECP. They seemed most pleased by the curricu\ura*s highly 
structured nature and its breadth of coverage. The weakness of the 
English syntax activities and the feeling that some activities are 
too elementary for some students were the mof^^t commonly reported 
disadvantages. 



Oral /Written Communi cation 

The Oral/Written Communication Component was implrmented at only one 
campus: Ortega. The Migrant teacher there worked with 26 students in 
grades one througli five. Because the component employed only one teacher, 
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very little Information was gathered except that neeadd to measure 
the component's objectives. The results showed that the objectives 
were greatly exceeded at grades one, two, and three. Grades four and 
five showed very poor gains. The objective at kindergarten was almost 
met. However, because the number of students tested at each grade 
l;ivel was so small, inferences about the quality of the program are 
difficult if not impossible to make. Had the component served more 
students, it is doubtf^il that the gains would have been as large at 
grades one, two, or three, or as small at grades four and five as those 
. .)und. 



Secondary Oral Language Development Componcnl 

The Secondary Oral Language Development Component provided instructional 
services to students in grades six through twelve in six schools (see 
Figure 1). Each school had one Migrant teacher except Johnston which 
had two. Migrant students at these schools were pulled out of their 
regular classes for instruction in oral language development by the 
Migrant teachers. 

A series of seven, day-long^ observations of the classes of each teacher 
under this comi/onent found significant problems with the "pull-out" 
method of scheduling instruction at the high school level. Students 
were not seen A5% of the time observations were scheduled. Some of this 
can be atCfibuted to a turnover in the Migrant teacher position at one 
school during the fall. If this is taken into account, the percentage 
of days during which no students were seen drops to about 35%, still 
a significant proportion. The primary reasons students were not seen 
seems to have been that the teachers had trouble locating and scheduling 
students at the beginning of each quarter and that students did not 
see the Migrant teachers during quarter exams. 

At grades six through eight, the teachers did not see students about 
30% of the time; however, at this level the reasons were different. 
Half of thn time they were personal, either illness of the teacher 
or a member of her family. In the other cases, the teacher was getting 
students out of class to see the Migrant Nurse, was substituting for 
another teacher, or was attending a conference. 

On the days students were seen, the secondary classes had the followir,; 
cha r ac t r I s t i cs . 

On the average, Migrant teachers saw four classes of migrant 
students for a total of about two hours and 35 minut^js a day. 

A greater proportion of class time was spent in oral language 
development at grades six through eight (45%) than At the high 
schools (25%). Half of the Instruction at the high school level 
was coded under "Other." 
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The O ral Lan^^ua^e Development Guid e was not used a great deal 
at either level. ^ 

About half of the pupil-ta:^her interactions were initiated by 
the teachers for the purposfe^.pf Instruction. Altogether, about 
63% o^ the interactions were for instructional purposes. 

An overwhelming majority, 96.2%, of the interactions occurred 
entirely in English. There was no relationship between the purpose 
of the interactions and the language used. 

Because it appeared from the 1976-77 evaluation of the Migrant Program 
that the levels of the CAT normally used were too difficult for some 
migrant students, achievement data collected to measure the objectives 
for the component were gathered urflng lower levels of the Instrument. 
The results showed that students at grades six, seven, eight, and eleven 
gained more than the national average. Students at grade nine met the 
component objective of .8 months growth per month of instruction but 
were still below average in their gains. Tenth and twelfth graders did 
not meet the objective. The tenth graders came close, but the twelfth 
graders did not. The difference in gains that emerges when grades six 
through eight are compared with grades nine through twelve may be due 
in part to the scheduling problems observed at the high school level. 
The gains made by the eleventh graders may be due more to the remedial 
instruction associated with the District's new graduation requirement 
than to the effect of the Migrant Program Instruction. The eleventh 
graders are the first class that must meet the requirement. The figure 
below shows the average month's growth per month of instruction for 
grades six through twelve. 



Grade Number Tested Average Gain Per Month of Instruction 

6 26 2.3 

7 53 1,6 

8 43 1.1 

9 33 0.8 

10 17 0.7 

11 31 1.3 

12 12 0.3 



In interviews with the secondary teachers, reading received the most 
support as the Instructional area that should be addressed by the 
Migrant Program. The current emphasis on oral language development 
was reported to be acceptable to the other teachers In schools with 
a Migrant teacher. 



The Suppor t Services 

The 197 7-78 Migrant Program provided a number of support services to 
parents, teachers, and students as aids to the instructional components. 
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TI.e Migrant Program provided clothing for qualified migrant students 
wIk) showed a need. To receive clothing a student must, by regulation, 
be served by a Migrant teacher or another supplemental instructional 
program. Clothing was purchased for students by the community represen- 
tatives upon the request of a parent or teacher. The Migrant Program 
set xside $5,200 for clothing purchases at the beginning of the school 
year. 8y tlie end of April, they had spent about $4,000 of that sum, 
A duplicated count of students receiving clothing by month showed 176 
purchases made between July 1, 1977, and May 1, 1978. The average amount 
of these purchases was about $22.50. Travis Heights was the only school 
served by a Migrant teacher in which some students did not receive 
clothing. Additionally, some migrant students served by supplemental 
programs In seven; schools without a Migrant teacher received clothing. 

The interviews of parents, Migrant teachers, and principals with a Migrant 
teacher all contained questions about the clothing benefits for migrant 
students. All p;3 vents interviewed whose children had received clothing 
and/or medical benefits, reported being satisfied or very satisfied. 



The Migrant teachers had a more mixed reaction to the clothing purchases. 
Five felt no change was needed. Six felt improvements could be made 
and offered suggestions such as completing the purchase of cold weather 
clothing early in the school year and keeping teachers better informed 
about which students have been served. The principal interviews revealed 
that only two of the twelve knew that migrant students must be served 
by a supplemental instructional program before they may receive clothing. 
Not all principals interviewed knew that the Migrant Program could provide 
clothing for their students. 



H eal th Service s 

The Migrant Program employed a Family 
Nurse Practitioner who provided 
health services for migrant students. 
The nurse did rep.ularly scheduled 
screenings of migrant students as 
well as non-scheduled exams upon the 
re(|uests of teachers or parents. 
The figure to the right shows the 
kinds ot contacts the nurse bad 
with students and their frequency, 
A great variety of problems were 
found by the nurse; however, dental 
problems occurred with a greater 
frequency than others. The single 
nu)St frequent action taken by the 
nurse was to contact the parents 
either by phone or by note. Her 
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second most common response was to counsel the students. A total of 
508 students were referred to other professionals for care; 280 to 
physicians and 228 to dentists. 

m 

Initially » $10,303 was allocated for paying physicians and dentists. 
Funds were later transferred from other accounts so that by the end 
of April the amount had risen to $15,005. Bills totaling $13,269 
had been received by April 30, 1978. 

Interviews of parents and migrant teachers showed that they felt that 
the quality of health care offered by the program was high. The 
general reaction uf the teachers was that the scope of the program 
should be expanded. They would like to see the nurse more frequently 
and would like to see more money available for medical and dental 
care. All of the principals interviewed knew that health care was 
available to their migrant f^tudents. 

Identification and Recruitment: of Migrant Students 

before students may be served by the Migrant Program, their parents 
must complete an Fligibility/Identif ication form. The 1977-78 forms 
were completed during home visits by the community representatives 
who worked under the direction of the Migrant Parental Involvement 
Specialist. They were kept on file by the Program as evidence of 
eligibility. Altogether, 1084 students were registered by May 1, 
1978. More then 50% of the registrations were completed in July 
and August. The Parental Involvement personnel made about 950 
home visits to recruit students between July and the end of April. 
This Is about 16 recruitment visits per month per recruiter including 
the Parent Involvement Specialist. , 

Since Austin began its Migrant Program, concern has been expressed 
by parents, teachers, and administrators that not all of Austin's 
migrant students are actually migratory. There is little that the 
evaluation of the Migrant Program can do to shed light on the question 
given the resources available; however, from the data gathered this 
year, the following statements can be made: 

The families of many of Austin's migrant students do not travel 
far to engage In their migratory employment. The parents of 
about 30% of the migrant s|||dents reported on the Eligibility/ 
Identification forms that they migrated within Travis County 
or one of the four contiguous counties; Bastrop, Blanco, Caldwell, 
or Williamson. (The figure on the next page shows where Austin's 
students migrate within the State of Texas.) 

When the reports of where they migrated given by 17 parents as 
part of the parent Interview were compared with their responses 
to the Scime question at the time of registration, nine of 
17 did not match. 



Where AusMn's Students Migrate in Texas 




When the teachers were asked what percentage of their students 
they thought were not migrant, the responses varied greatly. 
Six reported knowing of none who did not meet the definition; 
three gave qualified answers; and four Indicated that some of 
their students were not migrant. One teacher estimated that one 
half of her currently migratory stuf'i^nts were not in fact migratory. 

The interviews of principals with Migrant teachers showed that 
only about half ware able to give the essence of the definition 
of a migrant student. 
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Parental Involvement 



In addition to clothing purchases and recruitment, the Parental 
Involvement personnel were responsible for the establishment of 
Parent Advisory Councils (PACs) for each local school with a Migrant 
teach«.r and for the Dlatirlct as a whole* The migrant PACs were 
geneially combined with the Title I Regular PACs where they existed 
on the dame campus* The Districtwide PAC was also a combined Title 1/ 
Migrant PAC. 

The Migrant Program showed great improvement in the establishment of 
local PACs this year. In 1976-77 only five local PAC meetings were 
held and not all schools Kad' a' PAC meeting* This y?ar a total of 44 
local PAC meetings were he. d, and each school had. meetlngr* The 
attend.T.ce by migrant parents at the Dlstrlctwlde PAC meetings almost 
doirb^iid from 35 (duplicated count) in 1976-77 to 69 (duplicated count) 
thif. year. The average number of parents attending each local PAC 
meeting pet school, though, was small* 

Interviews of the principals with Migrant teachers showed that very few 
were completely familiar with who may serve '^on the local PACs* While 
three quarters knew the name of the Parental Involvement Specialist, 
only about one third knew the name of the community representative for 
their schools. 

Four of the thirteen teachers interviewed felt that the parental 
involvement activities were being satisfactorily Implemented. The 
concerns of t;he remaining teachers lAy in four areas: the amount of 
training parents w^re receiving in working with their children, the 
frequency with which the representatives visited the schools, the 
Parent Advisory Council meetings, and the amount of information 
that parents have about the Migrant Program. 

interviews of tlie officers of the Districtwide PAC revealed the following 

In ^neral the PACs have kad access to the Title I and Migrant 
information that they have needed. 

Dlstrlctwlde PAC membero have received copies of the regulations 
and guidelines which govern Title I and Migrant, although 
the local PAC members have not* 

Thi> officers were dissati'sfied with the training that they 
received In their roles as officers. They did, however find 
attendance at statewideu^meetings on parental involvement 'helpful* 

It was the general consensus of the parents that the opportunities 
to advise tne staff on the Tit^e I and Migrant applications 
were inadequate. They felt that they should have been involved 
earlier in the^lanning process and that there should have be'in , 
more lime to review the completed proposals before their sub- 
mission to the Texas Education Agency. 
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They felt that relations with the program staffs had been good 
despite the disagreements that occurred. 

There 1^ a need for Increased Involvement In PAC activities by 
Black ind Anglo parents. 



v Staff Development 

The Migrant Program sponsored a total of four workshops for Migrant 
teachers, two for the pre-klndergarten teachers and two for the second- 
ary teachers. In addition, the secondary teachers met five times 
between the middle of February and the end of April to discuss the 
Implementation of the Secondary Component. The tour staff development 
sessions that were evaluated were given above average ratings by 
the participants. 

For the bulk of their staff development, the Migrant teachers 
attended staff development activities in their schools on the 
District staff development days. 



Summary 

The Pre-kindergarten Component remained the Instructional highlight 
of the Migrant Program. The program was well implemented and the 
students showed Impressive gains. 

Achievement gains at the secondary level (6*12) appeared to be 
greater than In 1976-77 although significant problems In Implemen- 
tation were found during observation. Part of the gain In achievement 
was probably due to In^p roved testing procedures. 

The Migrant Nurse has done a thorough and highly regarded Job of 
providing health care. 

There was great improvement in the establishment of local PACs, 
and attendance at the Dlstrlctwlde PAC meetings almost doubled. 
Attendance at PAC meetings at both levels, however, remained low. 

The PAC officers felt that their opportunities to provide Input Into 
the development of the Title I and Migrant applications was Inadequate. 
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Publication No, 77, 58 
(Technical Report) 



ABSTRACT 



Title: 1977-78 Title I Migrant Technical Report 



Contact Person: David Doss, Paula Matuazek 



No, Pages; 376 



Summary : 



This is the companion document to the 1977-78 Title I Migrant Final 
Report , A copy of the report can be found in this chapter of the 
1977-78 Evalua ion Findings volmne. 

The Technical Report consists of 22 appendices. Each appendix reports 
the information collected using one or more related information sources, 

\ 

Each appendix contains: 



Instrument Description 

Purpose of data collection 

Procedures of data collection and analysis 

Summary of Results 

Tables and figures presenting the results 

The Technical Repor t contains the following appendices: 

Bilingual Early Childhood Program Mastery Tests 
Boehm Test of Basic Concepts 
Metropolitan Readiness Test 
California Achievement Tests 
Sequential Tests of Educational Progress 
Tests of Basic Experiences — General Concepts Test 
Pre-kindergarten Observation Form 
.Secondary Observation Form 
Classroom Observation Reaction Form 
Migrant Student Attendance Forms 
Teacher Records 
Migrant Teacher Interview 
ftincipal With a Migrant Teacher Interview 
Parent Questionr vire and Interview 
Migrant Student Master File 
Staff Development Forms 
Parental Involvement Travel Logs 
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Appendix R: 
Appendix S: 
Appendix T: 
Appendix U: 
Appendix V: 



PAC Information 
PAC Officer Interview 
Clothing Purchases Form 
Migrant Health Services Forms 
Staff\ Questionnaire 
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Publication No. 77.31 
(Interim Report) 



ABSTRACT 



Title; Needs Assessment for the Preparation of 1977-78 Applications for 
Compensatory Education Programs 



Contact Person; Paula Matuszek, Joy Heater, David Doss, Patay Totuaek 



No. Pages ; 722 



Summary; 



The seventeen sections in this needs assessment are: 



I. Introduction . A rationale for needs assessment is accompanied by a 
brief overview of the nature of this publication. 

[I. School Characteristics: Enrollment, percent attendance, percent low 
income, and ethnic distribution are given for the pf.st five years for 
all A.I.S.D. schools. 

III. Study of School Coats . Grant costs and other information relevant 
CO the question of distribution uf resources among schools is given. 
This information was prepared by the Department of Finance for pre- 
sentation to the Board of TruateM. It is included in this report 
in order to make it more accessible to planners. 

tV. Family Survey. Low 3ES and Minority Student Achievement Study . A 
survey of a sample of families in Austin that had either second or 
fifth grade students attending Austin schools was undertaken by the 
Low SES and Minority Student Achievement Study in 1977. Some of the 
preliminary results of this survey are included here. These result?! 
show by ethnicity .... 

1) Percent of Male Head of Household Working 

2) Percent of Female Head of Household Working 

3) Level of Education of Male Head of Household 

4) Level of Education of Female Head of Household 

5) Percentage of Students Havitig Preschool or Daycare 

6) Percetltage of Students Attending Kindergarten 

7) Percentage of Students Attending AISD Kindergarten 

8) Percentage of Students Changing Schools in the Past Year 

9) Number of Different Schools that Student Has Attended 

10) Parents' Rating of How Student is Doing in School 

11) Parents' Ratings of the School that the Student Attended 
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12) Amount of Educatlou Parent Would Lika to Sea Student Get 

13) Yearly Family Income 

V. Literature Reviews. Because It Is always Important before embarking 
on new educational et.'eavors to see what results have been recorded 
for similar endeavor.* in other situations, the following areas of 
Interest are summarized In literature reviews. 

1) Sibling Tutoring 

2) Parental Involvement and Sixth Graders 

3) Summer School for Low SES Students 

4) Math Programs for Low SES and Minority Students 

IV. Language Dominance Information. Information In the following categories 
Is given by grade level and school for all K-5 Elementary campuses. 

1) Number of English dominant children 

2) Number of Spanish dominant children 

3) Numbier of bilingual children 

4) Number of children for whom more Information is needed 

5) Number of children cor whom both scores were low 

VII . Overlap Study: The Number of Students Served by Multiple Programs . 

An ongoing concern of personnel Involved with special programs has 
been the overlap of services being provided to some students. In 
an effort to document the extent of this overlap, ORE conducted an 
overlap study in 1976-77 which defined the groups of students being 
served by each of the many possible combinations of special programs. 
The results of that stud> were sufficiently enlightening to encourage 
a repetition of that effort In 1977-78 In order to determine the- amount 
of overlap that might continue to exist. The results of the recent 
study are Included here. 

VTII. Achlavement Levels ; This section summarizes the scores obtained by 
A.I.S.O. students on four tests: 

1. ) Boehm Teat of F.^sic Concepts 

2. ) 'Metropolitan Readiness Test 

3. ) California Achievement Test 

4. ) Sequential Testa of Education Progress 



IX. Title I Sutaaer bchool. A comprehensive review of the results of the 
evaluation of Title I summer school is reviewed here. This information 
should prove useful to planners of summer school in genaral and Title I 
summer school in particular. 



X. Title I Parent Questionnaire . A short questionnaire was mailed to 
a sample of parents of Title I students in October of 1977. This 
chapter outlines their respones. 
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XI. Idtntif ication of Ticla I Students , Procedures and criteria for 

identifying Title I students are outlined, and a study of the lista 
id discussed. This s^udy shove the percentage of students on 
each campus who vere identified by test score and those who were 
identified by school recommendation. It also prints out the 
percentages or students who were identified for services even 
though their test scores were higher than the scores stated in 
the criteria, as veil as the percentages of students who were not 
identified for services even though their scores were low enough 
to automatically qualify them tor services* The percentages of 
students without any test scores at all are also noted. 



XII. Title I Mine Week Reports . Nine week report forms are completed by 
the Title I counselor, community representative, and instructional 
personnel on each Title I campus. Two types of summaries of hhe 
these reports for the first nine week period are included here: 

1) A general summary for each campus which shows the number and 
percentage of students served by Tide I instructional 
personnel, che community representative, and the counselor. 

2) Detailed school summaries for counselors and community 
representatives which show che activities that are included 
under the larger categories in the general summary. 

Separate chapters address the following areas of the Migrant Program in 
A.t.S.D. 

xm* Austin's Migrant Students: Where They Attend School. 

XIV. Austin's Migrant Students: What Is The Entry Achievement Level 
of che Pre-Kindergarten Students? 

XV. Austin's Migrant Students:- At What Level Are They Achieving? 

XVI. Austin's Migrant Students: What are Their Health Needs? 

XVT.I. Austin's Migrant Students: What Other Supplementary Programs Are 
Serving Them? 



Publication No. 77.10 
(Evaluation Design) 

ABSTRACT 
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Contart Person : David Doss, Paula Matuszek 
No. Pages : 26 



Content : 



The evaluation design is a one-yea 
project. The table of contents of 

I. Evaluation Design Review Form 

\^ 

II. Decision^ Questions 

A. Questions Addressed 

B. Overview 

III. Narrative Summary 

A. ^^^gram Summary 

B. Evaluation Summary 

IV. Information Sources Suumiary 



plan of evaluation work for the 
thl,s document includes: 

This chapter lists the names and 
positions of persons responsible for 
some aspect of program implementa- 
tion who were provided relevant 
portions of the design for review 
and comment. 

t. 

The decision questions addressed in 
the design are listed in section A. 
Part B lists the evaluation questions 
and information sources which will 
provide information relevant to the 
decision questions. 

This chapter briefly describes the 
Title I Migrant Program and the 
evaluation activities to be 
undertaken. 

This section provides by information 
source the population f rota whom 
information is to be gathered, 
the evaluation questions to which 
the information is relevant » the 
date the information is to be 
collected 9 and the analysis techniques 
to be used. 
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V. 



Summary of Data To Be Collected 
In The Schools 



this is a timeline for data collection 
in the schools. 



VI. 



Evaluation Time Resources 
Allocation Summary 



This chapter provides estimates of the 
time requirement (in person-days) 
of each aspect of the evaluation for 
each position associated with the 
evaluation. 



Evaluation Design Summary ; 

The evaluation of the Migrant Program for 1977-78 has two main functions: 

a) to collect and disseminate information relevant to the 
decision questions outlined in this document , and 

b) to report to the Texas Education Agency through interim 

and final evaluation reports on how well the Migrant Program 
is meeting its stated objectives. 

In carrying out these funcitons the Migrant Evaluation i^il collect three 
basic types of data: needs assessment data, process data, and outcome 
data. The needs assessment data will include such things as hot many 
migrant students are enrolled in the District and where , what their 
achievement levels are this year, and the*, degree to which migrant students 
are being served by other compensatory programs. 

Process data provides information about how well the activities proposed 
for the Program are being implemented. Data in this category include 
parent 9 teacher > and principal interviews , classroom observations, 
analyses of parent involvement personnel travel logs, and PAC meeting 
records • 

The outcome data will indicate the extent to which the Migrant Program has 
had an impact on the achievement of migrant students. The California 
Achievement Tests and the mastery tests of the Bilingual Early Childhood 
Program will be the measures used. 

Scope of Design ; 

9 Decision questions (system level and program level) 
55 Evaluation questions 



Publication No. 77.10 



Evaluation Resources Required (In person-days); 



,7.0 Coordinator 

52.2 Senior Evaluator 
230.0 Evaluator 

59. J Data Analyst 
212.0 Evaluation Assistants 

95.5 Secretary 



FINAL REPOR T 

E valuation Findings : ESEA Title VII BllinRual Project, 1977-1978 



Contact Person; (Uynn Ligon 



Sum roary of Ev alua tion Findings : 



Description of the Program 

The Austin Independent School District was funded for $628,681 under 
Title VII of the Elementary and Secondary Education A^t for the 1977- 
1978 school year to operate a demonstration bilingual prog^ram. This 
was the third year of a five-year project. Three thousand five hundred 
thirty-four students in ten schools from grades kindergarten through 
sixth grade were served by the project. Approximately one third of 
these students were in clasarooms where only state and local monies 
supported the services; however, since Title VII, state, and local 
classrooms team taught together, separating out effects of each funding 
source is impossible. Therefore, all results refJorted here are for the 
entire population of bilingual program students in these ten schools. 
Two of these schools served as demonstration sites for the dissemination 
of information and materials and for the in-class training of project 
teachers. 

The project had four major components. The Instructional Component coor- 
dinated bilingual instructional activities in project classrooms through 
supervision by project staff. At each grade level, teaching teams of 
bilingual and monolingual teachers conducted Instructional activities with 
the assistance of bilingual aides. The Staff Development Component planned 
and managed summer workshops ^or teachers, aides, and principals as well 
as on-campus J.nservice activities during the school year. The Curriculum 
Development component de>>eloped cultural units and units for the project's 
Experienced-Based Curriculum (EBC) activities which combined in-class 
instruction with first-hand field experiences. The Parental Involvement 
Component worked with project students' parents to inform them about and 
to Involve ihem in the education of their children. 



Evalu a tion Purposes 

The evaluation of t^e project had three foci. First, a major effort was 
made to document the on-going activities of the project to determine the 
level of implementation of proposed activities and to provide the staff 
with continual feedback. Second, student outcome objectives were measund 
In the areas of oral language, reading, and math in both English and Spanish 
Third, research designs were carried out to Investigate the benefits t^o 
derived from an activity-oriented experience-based curriculum. 
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Pn)(»t»ss evaluation of project activities lnclude<l administration of 
qiuist loanalres, workshop reaction fomis, and interviews in addition to 
rovlfw of available records documenting attendance at workshops, parental 
participation in school activities, and development of curriculum materials. 

Outcome evaluation Included the administration of a variety of instruments 
mainly to samples of project and non-project students. Locally-developed 
Kxper lence-Based Curriculum Tests in English and Spanish and El Exaraen de 
MatematLca en Espauol were used in conjunction with standardized tests for 
basic concepts, reading, and math in English. 



Evaluatio n Findint^s 

The evaluation design was planned around eight decision questions which 
the Title VII Bilingual Project must address. Thus, the results from 
the evaluation activities conducted are reported here accotdlng to these 
questions. The information provided through the evaluation is seen as 
contr lb\itlng to the answering of these decision questions along with the 
project staff's own observations and understandings of the political and 
practical constraints Imposed upon the project. 

Ih\nsi.oH Question I: Should the Austin Independent School District be 
th^fuHiird for ii fouvth ijimr of operation by ESEA Title VII? 

All of the succeeding evaluation information is relevant to this question. 
The Austin Independent School District has built up data on over 5,000 
students during the first three years of the project's operation and 
expects to be able to make a real contribution to the education of Spanish 
speaking children through the longitudinal study of these students* pro- 
gress through 1980. Contributions have already been made to the field of 
bilingual education in the areas of assessment of teacher competencies 
and use of activity-oriented experitnce-based curricula in a.idltlon to 
the contributions made locally to curriculum, staff development, and 
Instructional approaches on which Austin's overall bilingual education 
et r )rt is based. 

['^'•*uro>i .i^ucation :i: Hou) ahould tho Title VII Project^ other bilingual 
pro.ft^mu'^, tho Department of Elemeniarij Edu.-ation, and the Department of 
i'rvr iiprit!)!^ a! l'ro(iram8 ooordinata the curriculum^ instruction^ and super- 
vii^ion in proji'ct schools? 

A comparison of the 1977-1978 staff survey results to those obtained during 
the i>revlous year reveals very similar responses concerning coordination 
of Title VI T with the Department of Elementary Education and the Department 
of I)i«vclopmental Programs (Title I Regular, Title I Migrant, and State 
Ct)mpenBatory Education). Coordination," cooperation, and communication are 
nut currently satisfactory to those prograins* su|ir»rvi sors and coordinators. 
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The attendance of some personnel from other programs at the mdfithly 
BlLlnKual Education Task Force Meeting's appears to be the major recent 
Improvement, A few Title VTI staff members infrequently attend meetings 
of the Department of Elementary Education, Periodically, Department of 
Elementary Education personnel* have been involved ;tii special activities 
such as staff development and the writing of the Experience-Based Curriculum. 

Thv. supervisors and coordinators feel a need for improved coordination 
in all areas. In interviews, principals felt coordination could be improved 
by better comHiunlcation and by combining the many programs into a single 
program on each campus. Principals felt strongly that there are too many 
supervisors from too many programs attempting to influence instruction on 
their campuses. 

Most supervisors and coordinators of non-bilingual programs were aware 
that Title VII focuses on developing communication skills and overall 
achievement; however, tlielr knowledge of how Title V*ri is attempting to 
meet the instructional needs of its project students was quite sketchy. 
There does appear to be a need for Title VII to communicate its goals 
and activities to the other programs' staffs. 

Periodic meetings wi^re suggested as a means to improve coordination; 
however, several supervisors cautioned that available time for meetings 
Is scarce already. 

Di\nsioyi Question 3: What areas should be the foous of staff development 
act i 01 ties in L978-1971)? 

The Teacher Competency Test (Assessment of Teaching Competencies for 
Bilingual Education) administered in the spring of 1978 showed that pro- 
ject teachers agreed w^th the staff's philosophy and approach for bilingual 
instruction but did not possess high levels of knowledge in some areas of 
instructional techniques. Figure 1 shows the average percentage of correct 
answers given by project teachers to Items in each of the nine areas measured. 

Principals and the Title VII staff were surveyed to determine the areas of 
student achievement which they viewed as highest priority for Improvement 
so that staff development activities could be focused on providing teachers 
the skills to address these achievement needs. The staff unanimously cited 
communication skills, English and Spanish, as being their highest priority. 
Principals, on the other hand, focused on mbre general basic skills needed 
for achievement and, to a lesser degree cultural understanding and appre- 
c Icit Ion. 

A review of achievement test results shows kindergarteners to be doing 
better in relation to non-project students in acquisition of basic concepts 
than are students in the upper grade levels in reading and math. Achieve- 
ment in >panish content and language acquisition is almost impossible to 
lnterj)ret since no acceptable norms are available; however, project students 
do score he low both local and national norms on all achievement measures in 
English with the exception of the Boehm Test of Basic Concepts at kinder- 
garten and the California Achievement Test at grade one. 
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Figure 1. RANKING OF COMPETENCY AREAS (TEACHER COMPETENCY TEST) BY 
PERCENTAGE OF CORRECT ANSWERS 

In Interviews and on reaction forms, principals and teachers were asked 
to rate the success of the 1977-1978 staff development activities. The 
summer workshop and materials fair were highly rated and well received 
by the participants. The principals' workshop was also feen as beneficial 
by them, On-campus staff development activities were rated by the teachers 
as having been useful to them - 76% actually participated* Fewer, 56%, 
participated in materials-making sessions at the two resource centers. 

The 48 new teachers participating in the new teacher internships rated 
their value lower than did the participants in the previous year. These 
ratings were generally lower than for other types of activities. 

Teachers did feel that the pre-school campus planning sessions conducted 
by Title VII provided them with a better understanding of the scope of 
the bilingual program. Principals' assessments of these sessions ranged 
from ^'essential" to "useless." However, the principals felt the staff 
development activities conducted on campuses during the year were very 
useful and that their teachers were better instructors because of them. 

Tlie Staff Development Component far exceeded Its objectives for provision 
of at least four hours of training for teachers in the teaching of oral 
language development, reading readings:., and reading in both Spanish and 
English. From seven to 37 hours of vorkshops were provided in each area 
during the summer from which te. ne: t- could choose. Overall, these 
sessions were rated highly by the t/arllclpants, exceeding the objective 
of an average rating of 3.5 out of ^> oi a workshop rating scale. 
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DriUivion Qw^Ujoyi Uhut mC' ii fi (Mitii'mv^ i\houhl he ma<L\ in the, uupf^rvino^vj 

The project teachers expressed In fall Interviews the desire for supervisors 
to lielp them addiess needs In the areas of teaching oral language and ESL, 
grouping for roadLngi planning a fpaqlsh reading program for a few students, 
and understanding the^Tltle VII Teacher's Manual, Principals In spring 
Interviews expressed a ''desire for 3upervl8ors to do moro In^-depth work, 
with teachers In diagnosing needs, setting up groups, selecting materials, 
conducting demonsti atlon lessons, and discussing observations. Some 
principals also wanted supervisors to be assigned to a campus rather than 
visiting periodically. 

The success of the bilingual supervisors In meeting thf?lr objective of 
visiting each project classroom at least once per month was much Improved 
over the previous year. Figure 2 shows the percentage of project class- 
rooms visited each month in 1077-1978. Although in no month were all 
153 teachers vlptted, consistently over 90??! received visits each month. 

J)e<:nsion Qursdon What activities t>hould Title VIT aonduat in the 
iiveas of cj.nnaulm develcrmey t^ matevialsy and rjuidcs? 



During the 1977-1978 school year, the Title VII Project developed and 
disseminated to teachers six Experience-Based Curriculum Units along with 
necessary Instructional' materials and seven cultural units. Most teachers 
surveyed felt the; Experience-Based Curriculum IJnlts contributed' to their 
being better teachers. The units developed were sufficient to meet the 
project's curriculum objectives for the year* 
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Klj?ure 2. PKRCKNTAr.K OF TITLE VTl CLASSROOMS VTSTTED BY A BILINGUAL 
SUPERVISOR EACH MON^l 



xr. 



In t«rmH oi iMirrli ulum ni*eds, teacliers surveyed In the fall vranted materials 
on how to teach l';n^!,llsh as a second language and Spanish as a secH^nd lanRuage. 
Ma:iy other more diverse requests were also made. Principals focused more 
on supervision and follow-up as means to assure that curriculum Is under- 
stood '^d appropriate materials are used by the teachers. 

The project's objective of (»ach student's partici patl uR in at least fo c 
cultural units was not attained according to teacher survey results. Even 
though the project developed seven cultural units, 6A% of the teachers 
reported conduct ipj.; fewer than four units by March, 1978, 

/'I'.'/iW'. »>i irurstf^^y. th Wluit he th' fi^ci fov pav(miat involvement: 

j^VL\!e'*t u)fje? 

In the faU of: 1977, the Title Vll evaluation staff monitored the «ctiviti^^ 
of the projtct'^'s community representatives. Tlieir logs indicated that the 
most frequent functions performed included home visitations^ home telephone 
calls, recordkeeptng, and transporting parents and children to or from 
school-related activities. Community representatives also participated 
in conferences with teachers, principals, and school nurS(>s. 

Kach project school was to have a core of at least four parent volunteers 
who would be trained and would participate in project classrooms in a 
capacity related to instruction at least three times during the year. 
This obje(^t(ve was met or exceeded on eight of the nine campuses with a 
community representative. On the ninth, the parents identified as making 
up the core of volunteers reported that they were usfed .ly in non-instruc- 
t iona I activities • 

Records of parents' visitations to project classrooms showed 6,735 reported 
visits during 1977-1978. This exceeded the project's goal of 6,000. Of 
Interest is the fact that 4,720 of these visits were recorded from September 
to December, and fewer than half that many, 2,015, from January to April. 
This could reflect the actual contrast in participation levels from fall 
to spring or the relrxation of teachers and community representatives in 
their moi>itoring of the recording of the visits. 

A randomly selected group of parents of kindergarten and third grade project 
students were trained by the community representatives to use specially 
designed' Experience-Based Currlculnm lessons wililj. their children at home. 
When these parents were Interviewed in the spring, their levels of knowledge 
and support of school activities were no different than those of a control 
group of parents. When the gains made by the children whose parents were 
trained and used the home units were compared to a control group's, a 
difference In favor of the students whose parents worked with them was 
found In only one of |ix areas - Spanish vocabulary for kindergarten stu- 
dents. Figure i graphically displays the total scores of the two p.^oups 
on tlie Experience-Based Curriculum Test. The conculusions drawn are that 
the training of the parents and their use of the home units had no measurable 
or consistent effect upon the paronts' knowledge or attitudes or upon the 
children's le.irnlng the V(. abularv associated with tho Kxperlence-Based 
(lurr ItMilum. 
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Figure 3. COMPARISON OF EXPERIMENTAL (E) '^O CONTROL (C) PARENTS' 
STUDENTS' EBC SCORES 



Drtn.iiiim Quei^tion ?: Should the Title VII Bilingual Project implement 
iin (zct ioitfj-ortrnted ex{)erience'baeed curriculum? 

This question was researched by randomly assigning each grade level in the 
nine K-5 project schools to eithet an early treatment group or a delayed 
treatment group. Figure ^4 details the sequence of events for each group. 
The comparison being made was between the learning of students who parti- 
cipated in Instructional units presented by a trained teacher before and 
after field trip experiences and the learning of students who did not 
participate. 

The locally developed Experienced-Based Curriculum Test (EBCT) was admin- 
istered pre and post to measure acquisition of vocabulary related to the 
field experiences. As evidenced in the sample results displayed in Figure 
5, the students in the early treatment group did outperform the delayed 
treatment group. In eight of nine comparisons » in both English and Spanish 
the students participating in tht units and field trips outperformed the 
non-part Iclpanta. 

To assess more general achievement results from the experience-based 
Instruction, both the Hoehm Test of Basic Concepts (BTBC) for kindergarten 
and the California Achievement Test (CAT) for grades two through five were 
administered. Out of two BTBC and 12 CAT comparisons madci only one was 
statistically significant. The early treatment fourth grade students out- 
performed their comparison group counterparts on the CAT Vocabulary Subtest 
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In suimnary, the Experlence- 
Baned Curriculum was Buccessful 
In Leaching the target vocabulary; 
however, more generalized achieve- 
ment benefits were not evident, 

Daninon QMC^^tion 8: Aj'tev 
ly.mewinQ the leoelh (>/ attain- 
ment fov the project ^8 L9??-l9?8 
objtictivnij, what veviinone ahould 
be made to incveaoe the poasibit'- 
i tij of meeting thefu: objeativea 
more f'iily? 

P rocess Objectives 

An Instructional Activities 
Questionnaire was administered 
mid-year to elicit from project 
teachers their estimates of in- 
strucfioQal time in each area of 
the curriculum. In addition, 
the teachers were asked to iden- 
tify the materials they use lor 
instrucMon in each area. Figure 
6 shows the objective level in 
terms of hours per week of in- 
struction in each of 12 areas. 
Time in all areas exceeded the 
objective level set except for 
oral language and reading. 
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Figure 6. LEVELS OF ATTAINMENT FOR OBJECTIVES RELATED TO AMOUNT OF 
INSTRUCTIONAL TIME IN SELECTED AREAS 



Figure 7 looks at the teachers' reported use of materials identified by 
the Title VII staff and a curriculum committee with teacher representatives 
as appropriate. In about half of the instructional areas surveyed 9 the 
reported use of approved materials was below the 90% criterion level. As 
in the previous two years, the project teachers reported using a very wide 
variety of curriculum materials with little consistency being evident among 
the project scbools. 
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FlRun? 7. LKVKLS OF ATTAINMENT FOR OBJECTIVES REIJVTED TO INSTRUCTIONAL 
MATERIALS USED 
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All other procese objectives have been referenced previously under their 
appropriate decision questions* 



outcome Objectives 

Five major instruments were administered to measure the project's 11 
outcome objectives. Each outcome 'objective expected project students to 
demonstrate significant gains from pre-- to posttest. All except the one 
for achievement in math skills in Spanish expected project students to 
outperform non^projecb students enrolled in the Title VII schools. This 
group of non-project students is limited for comparison purposes because 
it is less Mexican American in. makeup* more English dominanti and concen- 
trated more in the higher achieving project acbools* These factors 
should be considered in the interpreting of comparisons made. 

Objective 1: English Oral Language Acquisition i Kindergarten The "f^AL 
Oral Language Dominance Measlii;^ was administered in September and in 
April to a sample of students in kindergarten. Figure 8 displays the 
relative levels of language proficiency In English and the gains demon- 
strated by students grouped according to language dominance and project 
status. There were an Insufficient number of Spanish dominant and 
bilingual non-project students to m^ke comparisons in these language 
categories. The pre to post gains were statistically significant for 
all groups. Neither the project nor the non-project English dominant 
students significantly outgalned the other. 
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Figure 8. .lATNS ON PAL ORAL LANHUAGE DOMINANCE hfEASURE 
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Objective 2; Spanish Oral LanguaRC Acgulaltlon. Kindergarten Figure 8 
also shows the same comparliona for the students* Spanish scores. Gains 
from pre :o post were significant. The gains In Span:*sh made by project 
students vere significantly greater than those made by the non-pioject 
students. 

Ob jective 3; Spanish Reading Readiness, Kindergarten The Boehra Test 
of Basic Concepts was administered In Spanish to over 100 project students 
In September and again In February. No non-project students were (ested 
in Spanish. Figure 9 shows that these students made significant gains, 
equalling the raid-year socio-economic norm on the posttest. 
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Figure 9. BOEHM TOTAL SCORE FOR STUDENTS TESTED IN SPANISH OR ENGLISH 



Ob jective A; English Reading Readiness, Kindergarten Figure 9 also shows 
that both project and non-project students tested In English on the Boehm 
Test of Basic Concepts demonstrated significant gains and exceeded the mid- 
year middle socio-economic norm. T\\e gains made by project students, how- 
ever » exceeded those of non-project students by two raw score points, a 
statistically significant advantage for project students. 

Objective 5; Math Readiness Skills in Spanish, Kindergarten The Quantity 
Subscale of the Boehm Test of Basic Concepts was used to measure math 
readiness acquisition. No n( i-project students were testod in Spanish. 
The project stvidents' gains were statistically significant. 

Obj ectiv e 7: M ath Skills in Spanish, S econ d, Grade El Examen de MatemStica 
en Espanol was administered to thoRe second grade project students who were 
receiving math instruction in Spanish. Their gains over the year were sig- 
nificant. 
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Objective 8: Math Skills In Engllalu Second through Fifth Grade Project 
atudimta demonstrated significant gains on the math subtests of 'the 
California Achievement Test; however, these gains were not statistically 
different from those of non-project students. 

Objective 9; Spanish Reading Skills^ Second through Fifth Grade The 
Prueba de Lectura was used as the measure of Spanish readloc proficiency. 
Figure 10 displays the project xstudents* gains over the year. ' These gains 
were significant; whereas, the gains for non-project students were not. 
Although the number of non-project students tested was small, their gains 
were not significant and were significantly less than those of the project 
students. 



Objective 10; English Qrq] I^ang^a^yp 
Acquisition, Second through Fifth Grade 
Project students demonstrated signifi- 
can^t gains on the Vrcabulary Subtest of 
the California Achievement Test; how- 
ever, these gains were not Statisti- 
cally different from those of non- 
project students. 

Objective 11; . English Reading Skills , 
Se cond through Sixth Grade Project 
students demonstrated significant gains 
on the ?eaJlng subtests of the Cali- 
fornia Achievement Test; however, 
these gains were not statistically 
different from those of non-project 
students. 

A three year look at achievement 
trends Is represented in Figure 11. 
The differences between the project 
and non-project students are not 
statistically significant for this 
year's third, fourth, or fifth 
graders. 
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Figure 10. GAINS IN SPANISH 

READING (PRUEBA DE 
LECTURA-TOTAL SCORE) 
FOR PROJECT STUDENTS 
IN GRADES 3, A, AND 5 



The overall picture of the attainment of outcome objectives by the project 
Is presented In Figure 12. On every measure, project students made sig- 
nificant gains during the year. On half of these measures their gains 
were significantly greater than those of non-project students. On none 
of these did non-project students significantly outgain project students. 



S um ma ry 

The Title Vtl Bilingual Project met its objectives for delivery of services 
to the project classrooms. Within the classrooms, the anticipated time de- 
voted to different areas of Instruction occurred with the exception of 
Spanish oral language and reading. Project teachers continued the use of 
a very wide variety of curriculum materials, often not using those recom- 
mended by the project staff. Coordination of Title VII activities with 
those of the local program and other special projects Improved very little 
and remains an area of need. 
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Figure 11. READING TOTAL, CALIFORNIA ACHIEVEMENT TEST, 1976-1978 FOR PROJECT (P) 
AND NON-PROJECT (N) STUDENTS 
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Figure 12. SUMMARY OF ATTAINMENT OF PROJECT OUTCOME OBJECTIVES, 1977-1978 
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The Experlence-Buaed Curriculum again proved to be a viable approach to 
teaching; however, generalized effects on achievement were not found. 
Parents who were trained to use related activities with their children 
did not evidence a change in attitudes or knowledge of school activities 
Their children did not learn more than those of parents who were not 
participating In the project. 

Kindergarten project students demonstrated real gains above and beyond 
those of non-project students in English and Spanish reading and math 
readiness skills. In the upper ^rade levels, project students held an 
advantage in Spanish reading achievement but there were no differences 
In achievement measured in English. 
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Publication Number 77.44 
(Technical Report) 



ABSTRACT 



Title; Final Technical Report - ESEA Title VII Bilingual Projact, 
1977 - 1978. 



Contact Person; Glynn Llgon 



No. Pages ; 610 



Summary ; 

This report contains 27 appendices each detailing the Information 
collected by a specific data collection measure. 

Each appendix contains; 

Description o)E the Instrument 
Purpose of the Measure . 
Procedures for Administration 
Summary of Results 
Figures of Data 

This report contains the following appendices: 



Appendix A 
Appendix B 
Appendix C 
Appendix D 
Appendix E 
Appendix F 
Appenc^ix G 
Appendix H 
Appendix I 
Appendix J 
Appendix K 
Appendix L 

Appehdix M 
Appendix N 
Appendix 0 
Appendix P 



Appendix 
Appendix 
Appendix 
Appendix 



Appendix U 



Oral Language Domirance Measure (PAL) 

Spanish Screening Test 

Experience-^Based Curriculum Test (E^T) 

Parental Involvement Record Sheet 

Fall Teacher Interview Form 

Instructional Activities Questionnaire (lAQ) 

Workshop Reaction Form 

Spring Teacher Questionnaire 

Community Representative Monitoring Sheet 

Internship Reaction Form 

Principals* Workshop Reaction Form 

Teacher Competency Teat (Assessment of 

Teaching Competencies for Bilingual Education) 

Staff Questionnaire 

Principal Interview 

Parent Interview Form 

Spanish Math Test (El Examen de Matematlca en 
EspaTtol) 

Spanish Reading Test (Prueba de Lectura) 
Boehm Test of Basic Concepts 
California Achievement Test 

Documentation of Mi'.terlals Sent to the Schools 
Documentation of Staff Development Activities 



Appendix V On-Site Inservlce Records 

Appendix W Parent Advisory Group Sign-In Sheets 

Appendix X Records of M terials-Making Activities 

Appendix Y Supervlflor's Record of Classrooms Visited 

Appendix Z Teacher Sign-In Sheets 
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(Interim Rtport) 



ABSTRACT 

Title ; ESEA Title VII Interim Report (Dec, 1977) 
Deacrlptlon of th> Progran 

The Austin Independent School District Is funded for $628,681 under Title 
711 of the Elementary and Secondary Education Act for the 1977-78 school 
year to operate a demonstration bilingual program. This is the third 
year of a projected five-year program. Ten schools with approximately 
3,400 students In 153 classrooms in grades kindergarten to six participat 
in project activities. Two schools serve as demonstration sites for 
the dissemination of information and materials and for the in-class 
training of bilingual program teachers. 

The project has four major components. The Instnictional Component 
coordinates blllng\ul instructional ^tlvities in all project class- 
rooms through supervision by the project staff. At each grade level, 
teaching teams of bilingual and monollngi^l teachers conduct Instruc- 
don. Bilingual aldeii assist the teams at the various grade levels 
according zo need and availability . The Staff Development Componen^t 
plans and conducts a large number of training activities for taachers 
and aides. In addition, teachers and full-time students receive 
financial support for pursuing professional degrees and certification. 
The Curriculum Development Gomponenc identifies, adapts, and develops 
materials for instruction. The Parental Involvement Component plans 
and effects project-wide and local campus parent training and involve- 
ment activities. 

A major activity for all components is the preparation and implementation 
of an actlvity-oriented/experience-oased curriculum. 

Evaluation Purposes 

The evaluation of the, project has three Joel. First, an effort is 
b^ing made to document th« on-going project activities and to provide 
thi staff with feedback. Second, project student outcome objectives 
are being measured ln> the areas of oral langxiage development, reading, 
and math. Third, research designs are being carried out to investigate 
the relative benefits to be derived from the use of at-home study units 
by parents trained by community representatives and from the activity- 
oriented/experienpe-based curriculum. 

Evaluation Findings 

The Title VIl Project la at about the same level of implementation as 
it was last year. That is to say, in December of 1976, the project 
had registered the highest level of laplemenUtion since Its Inception 
in 1974. Insofar as the material and organizational resources available 
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CO the project staff ar« concerned, the endeavor to make bilingual edu- 
cation a meaningful part of the AI^D curriculum is at its highest level ever 
as it 'can possibly get. It would now be in order to examine the ways 
in which the bilingiuLL program can be further enhanced at the local 
campus level. The level of instructional and supportive services 
continues to be high, and whether this will result in the aieetlng of 
student outcome objectives cannot be determined until June, 1978, when 
> the achievement testing has been conducted and analyzed. 

laatructlon 

A guide to the project, and Its activities has been provided to all project 
teachers as a response to their desire to have a ready reference to 
Information concerning the Title VII Project. The low return of the 
Instructional Activities Questionnaire from teachers makes it difficult 
to gauge precisely the utilization of the core curriculum. Judging from 
the questionnaires that have been returned, however, it seems that a 
very wide variety of commercial and teacher^made materials are being used. 

With respect to the visitation of classrooms, 94'^ of project clas. • s 
vers vis Iced at: least once a month from September through November. 
These vi^sitations consisted mostly of assisting the teachers to upgrade 
inatruction, demonstration lessons, planning instruction, and ordering 
materials . 

Scar: Development 

The summer workshop conducted for a week in August, l5^7, was rated by 
the participants as having been productive. Since August, staff develop- 
ment has been conducted or planned by the project staff, as required, to 
individuals or groups. As of November 3O9 the project had conducted 
about forty-three of these individualized, on-campua training activities. 
A two-day workshop for principals was also conducted in the summer. 
Responses of those participating indicated support for this type of 
activity* However, participation for the workshop for principals was 
not high. 

Curriculum Development 

Objectives for curriculum development have already been met. The EBC 
units and learning kits have been completed and distributed to the 
campuses. Culturally relevant units have been prepared and sent to the 
teachers Other English and Spanish language materials will be dissem- 
inated as they become available. 

Parental Involvement 

Monitoring of the community representatives^ daily logs has shown home 
visits and phone calls to parents to be two of their major activities. 
All of the iC-5 schools have already identified and trained a core of 
four volunteer parents to assist in ins true tionally related acrlvitles. 
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Monthly racord shacts are btting ktpt on-campus to documant contacts 
with parents, relatival, or guardians. As of November 30, almost 
4^000 contacts have been made between teachers and parents li: the 
classroom setting. 

A proj act-wide newsletter will be published before the end of the 
first semester. Another newsletter will be distributed at the end of 
the 1977-78 school year. 



Publlcatio . No. 77.14 
(Interim Report) 



ABSTRACT 

Title ; Bilingual Communication Skills Workshop, 1977-1978 
Contact Pe-son '. dynn Ligon 
No. Pages : 132 
S ummary ; 

The summer workshop for project teachers and aides was conducted from 
August 8 through August 12, 1977. For each workshop sessloni participants 
were asked to complete a reaction form rating that session from 1-5 
for Its success In meeting the objectives posted. In addition i an over-* 
all reaction form was completed by a sample of participants on the last 
day of the workshop. 

Generally, all the sessions were well received by the participants. 
The ratings centered around 4.4 for meeting of objectives and around 
4.6 for the knowledgeablllty and preparedness of tl],4^, ^consultant. 

Participants' general comments were In favor of more materlals--maklng 
sessions, shorter and more varied sessions, and more teacher Input into 
the selection of consultants. 

This volume contains a detailed summary of the objectives, ratings, and 
comments for each session. 



Publication No. 77.11 
(Interim Report) 



ABSTRACT 

Title ; Achlevetnent Test Profiles, ESEA Title VII Bilingual Project, 
. .1977-1978 



Contact Perso n; nlynn Ligon 
No. Pat^ea : 66 
Suniina^y : 

This volume contains graphic auramarles of the student outcome results 
for the project schools during the 1976-1977 school year. 

For each instrument there Is a guide to Interpreting the results and 
then Indiv'.dual school profiles. 

The instruments and scores presented are; 

Boehm Test of Basic Concepts- Total Raw Score 

California Achievement Test- Reading Total Percentile 

Math Total Percentile 

Prueba de Lectura- Total Raw Score 
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Publication Number 77.07 
(Evaluation Design) 



ABSTRACT 



Title ; ESEA Title VII Bilingual Project 1977-1978 Evaluation Design 



Contact Person ; Glynn Ligon 



No. Pages ; 45 



Content: 



The evaluation design is a one-year plan of evaluation work for the 
project. 



I. Evaluation Design Review Form 



This chapter presents the names and/or ' 
signatures of persons (responsible for 
some aspect of the project's implementa- 
tion) who have been provided relevant 
portions of the design for review and 
comment • 



II. Decision Question 

A. Questions Addressed 

B. Overview 

III. Narrative Summary 

A. Program Simmiar/ 

B. Evaluation Summary 



Here the evaluator states all the decision 
questions and relates them to the evaluation 
questions and objectives (and their data sources). 

This chapter briefly describes the project and 
the evaluation activities tied to the project* 



IV. Information Sources Sunmary 



V. Summary ot Data to be 
Collected in the Schools 

VI. Evaluation Time Resources 
Allocation Summary 



The principal evaluator(s) provide work 
estimates (in person-days) for each person 
on the evaluation team. Work estimates are 
projected for each "Information source'* 
and are broken iiito the four types of eval- 
uation lasks: development » collection^ 
analysis ) and dissemination. 

This is a timeline for the collection of 
data in the schools. 

This chapter summarizes ail the evaluation 
work estimates (in person-days) by position^ 
for each aspect of the evaluation. 



VII. Program Planning Sheets 



Chapter VII includes the program plans which 
relate program needs to student outcomes 
(including measurable objectives) » classroom 
processes^ inputs to classtooms^ staff /program 
activities 9 and staff resources. 



o 
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Evaluation DeslRn Summary ; 

In addition to meauuring input, proceaa, and outcome objectives, the 
evaluation includes research designs for investigating the efforts 
of the project's Experience-- Based Curriculum. All of this is done 
within thii framework of decision and evaluation questions. 

Scope of Design; 

8 Decision questions 
24 Evaluation questions • 
AO Objectives 

Evaluation Resources Required {in person-days) ; 

11.0 Coordinator 

42.0 Senior Evaluator 
172.5 Evaluator 
180.0 Data Analyst 
240.0 Evaluation Assistant 
240.0 Secretary 



FINAL REPOR T 

KY-QAhQ L .1 on : State Componsatory Education Progr/<m, 1977^78 
PilDJL^i^JL jj^J?A9J^ Patsy Totusek> Paula Matuszek 



Summary of Kva.lua tio n Findings ; 

The 1975-76 school year was the first opportunity for Texas schools to 
take advantage of State Compensatory Education (SCE) funds* The SCE 
program is biennial, in that SCE funds are appropriated for a two-year 
period, after which time additional legislation must occur if the funding 
is to be renewed. SCE funds for the 1977-79 interval were made available 
to Texas Hchools through the actions of a special summer session of the 
1977 Texas Legislature, Austin I.S.D. received approximately $A00,000 
for planning and implementation of its 1977-78 SCE program. 

SCE services .have been offered in the sixth-grade schools since the 
inception of the program. The aixth-grade schools were established in 
the fall of 1973 as agents for desegregation. The reorganization of 
Austin schools which accompanied their creation caused new needs to arise 
During 1975-76, many of the sixth-grade centers did not have adequate 
materials to instruct their educationally disadvantaged students, and 
staff development was needed to teach instructors how to work with low 
achieving children. It was felt advisable to use SCE funds in the sixth- 
grade schools for material acquisition and staff development purposes, in 
that such expenditures would extend the life of the program should the 
program fail to be renewed. Each sixth-grade campus planned its own SCE 
program^, and no additional staff personnel were hired to administer or 
monitor SCE activities. 

In 1977-78, many of the sixth-grade campuses employed SCE funded per- 
sonnel to work with SCE identified students. Six of the eight SCE school 
hired SCE Heading Teachers to work with SCE students. Furthermore, a SCE 
Coordinator /Supervisor was employed to assist in the planning and moni- 
toring of program activities. 

In addition to tht Sixth-grade Basic Skills Component described above, 
the 1977-78 SCE program contained a Planning Component, an Evaluation 
Component, and several coir^'^n^nt; relating to curriculum development. 
The Planning Component con ted of three planners who were assigned spe- 
cific tasks related to local, state, and federally funded programs. 
Evaluation activities were designed so as to assess the degree to which 
component objectives were met. The curriculum design components were 
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i'DiUMMiU'tl with J'Vi'lopJny; vMirrLcular mater L/il s for I'diK^^it Joaally 
tl Isad^ .intaKi^Hl st udiMils. 

Tlie t»valuatlon t Indln^s will, be Hummarlzed according to the decision 
question for which they are re levant • The system-level decision ques- 
t Ii>nH are addressed first, followed by the program- level decision 
(|iU'St Ions. 



'N*.^'.L^JilFL iiyjr.^^ Ir^^l^J gjiould the C^^ Planners continu e to coor- 

il I na t e^ federal > state, and local program activities? 

Ten (^biertlves were listed for the 1977-78 Planning Component/ Seven of 
the' .bji,':tlves were completely attained. These objectives required the 
pL vve»" t:o: 1) assist In the development of a comprehensive summer 
sth .>l y.a-. among Title I, SCE, Title 1 Migrant, AISD, and the Vietnamese 
|)ro>;i. v'^: 2) complete a demographic study for use in planning potential 
loeati ,ns of new Title 1 schools; 3) assist in drafting copies of a 
Parental [nvolvement Reading Program; 4) produce a reading curriculum for 
the summer school program at Blanton; 5) develop a coordinated applica- 
tion tor the integration of Title I and SCE through the Consolidated 
Application for State and Federal Assistance; 6) coordinate the At-Home 
Program for Title I; and 7) assist in the development of major compenj:.a- 
tory applications. 

Iwo objectives were partially attained. One of these objectives stated 
the Compensatory Planners would assist in "City Games/' a cooperative 
environmental design project to bt piloted in SCE schools. Two Compen- 
satory Planners stated they had not been involved in completion of this 
objective. The third Compensatory Planner said she had attended the 
meetings at which the project had been Introduced to teachers and prin- 
cipals, but had not been actively Involved ^n completion of the objective. 
She considered herself '*on call** should any problems arise* The second 
partially attained objective stated the planners would assist in developing 
a plan for a Fine Arts Strand for use in Title I schools. Although one 
planner compiled sotiie research on language development as it would apply 
to a Fine Arts Strand, furtlier activities were postponed because the 
Director of ^)evelopmental Programs did not feel it was feasible to obtain 
TKA approval for the project at the time. 

The tenth objective stated the planners would develop models for the Title 
1 proKUun for 1978-79, Since a decision was made to continue the current 
Title I models, this objective was no longer appropriate. 

The total cost of the SCE Planning Cor'» ■ • t for tlie 1977-78 year as 
n^piirted In the Annual Evaluation Repo/ i < TEA, was $135, 7AA. 
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Dec i H ion l^ues t ton ; What role should the jj^pj^^tment o f De velopmental 
Programs staff and the SCE Co o rdlnato tVSuperviHor play in t he local 
t; ampus^ J?J'-iyy^i."Ji^.9 f_J5CE Ji^£ti vit ies ? 

Interview Inlormation obtait)ed from the Director of Developmental Programs, 
the Educatlonai Planner, and the SCE Coordiaator/SupervLsor was used to 
document tht^ role of the Department of Developmental Programs staff and 
the SCE Coordinator/Supervisor in the planning of 1977-78 local campus 
activities. 

Informal planning began in February of 1977, when the Director of Elemen- 
tary Education called a meeting for preliminary planning with sixth-grade 
principals. The Direct c^r of Developmental Programs asked the principal 
of each sixth-grade school to submit a memorandum to her regarding needs 
and budget requests for the 1977-78 school year. Formal planning of 
1977-78 SCE local campus activities began with a meeting of the SCE Task 
Force on wlune 2. The Task Force consisted of selected district personnel. 
The puriiose of the Task Force was to determine how SCE monies shouJd be 
spent in thf Aust?n Independent School District, 

During the month of June, the SCE Coordinator/Supervisor requested each 
sixth-grade principal to submit a written statement of their school's 
SCE needs. According to the SCE Coordinator/Supervisor, approximately 
one-half of the SCE principals complied with this request. The remaining 
principals were contacted by telephone and requested to state their SCE 
plans orally. Telephone contact or visits to the school were used by 
the sCE Coordinator/Supervisor when further confirmation or discussion of 
a school's plan was necessary. The SCE Coordinator/Supervisor said he 
was not generally aware of the process schools used to derive a statement 
of their needs, 

(M vJuly 26, 1977 > the Director of Elementary Education held a tiieetlng 

for the SCE principals and area directors. Among other things, the SCE 

Extended Year Program was reviewed (a summer school component In the 

original 1977-78 SCE application), and the principals' reactions to 

the SCE program were discussed. It was the SCE Coordinator/Supervisor's 

fooling that the SCE principals agreed tn participate in the Summer Extended 

Year Program at this meeting. 

The SCE Coordinator/Supervisor said all the SCE principals had completed 
thoir 1977-78 SCE school plans by August 2, On August 3, the SCE Coordina- 
tor/Supervisor sent each SCE principal a statdnent of the final appropri- 
ation for their school's program for the coming year. 

In Janih^ry, 1978, the Director of El(MnenLary Education held a meeting with 
the SCE principals and personnel from the Department of Developmental 
Programs to discuss the Summer Extended Year Program, It was decided at 
that tlmo that tlio Summer Extended Year Program would not be implemented 
as planned. Several of the principals did not want to participate in the 
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projrram. In tliat. tlu?y felt they had not been consul tt^d in the planning 
of Lht! proKram, and that the program did not take Into consideration 
Kome variables whlcli would hinder its effectiveness. From January to 
rebruary, the SCI- Coordinator/Supervisor met individually with the SCE 
principals to determine how they could best use the $70,000 made available 
r.hrou>j;h the chauKe In the Summer Extended Year Program. 

Information obtained in Interviews with the SCE principals revealed only 
three of the eight principals were generally satistied with the 1977-78 
planning process. Four principals said there was not enough time during 
tlie planning procedures to acquire teacher input. Six principals said 
Inadequate information was provided about the distribution of all SCE 
funds. Five principals said insufficient information and gnidelines were 
provided for local campus planning. Four principals said Inadequate 
advance notice was given for meetings with the Department of Developmental 
Programs staff. Three principals said some sixth-grade principals should 
have been invited to participate on the SCE Task Force. 

The Director of Developmental Programs said some problems occurred during 
the planning process due to inaccurate assumptions about the needs of the 
principals in planning their local campus programs. She said several steps 
will be taken in planning the 1978-79 programs to correct previous diffi- 
culties* Among other things, the Director of Developmental Programs said 
plans were being made to develop a time-line showing critical decision 
making points. Guidelines for local campus planning activities would be 
made available, and more group meetings allowing SCE principal Interaction 
would ho. held. The SCF Coordinator /Sunervisor said he would like to see 
prtigrani planning hogin earl it»r so as to allow more rime for decision 
making. 

The SCK principals also had several suggestions with regard to improving 
the planning process. Two principals said each sixth-grade school should 
be provided with an expenditure limit to use in planning their projected 
SCK activities. Two principals said th»: method of allocating funds to dif- 
ferent SCE campuses should he explained. Six principals said more advance 
notification of Departmental ' of Developmental Program (DDP) meetings would 
he helpful, and four principals suggested time at DDP meetings be allowed 
for them to discuss their SCE plans and experiences. One principal .said 
the DDP staff should attempt to be more aware of the principals' planning 
nt^eds. Another principal said the Department of Curriculum and Instruction 
sliould be provided with adequate information nbout SCE activities to allow 
them to assist the principals with SCE projects. Three principals felt some 
of the sixth-grade principals should participate in determining future SCE 
program prlorft tcs. One principal felt the DDP staff should provide greater 
assistance to tlic principals In planning the practical aspects of a summer 
s(^hoo I program* 
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P^^* l^ion (jue atlon : WVilc h SCE local campu s acti vities should be continue d? 

With only a few mLnor exceptions, the SCE program activities implemented 
at each aixth-grade school corresponded with the projected SCE local campus 
activities described in the 1977-78 SCK application to TEA. 

Four schools (Baker, Blanton, Read, and Travis Heights) included video- 
tape activities in their SCE school plans. Most of the videotape 
activities at Blanton centered upon teacher^produced lessons, while most 
of the videotape activities at Travis Heights involved the taping and showing 
of commercial programs. At both Baker and Read, the greatest percentage 
of videotape activities involved taping or showing a tape of students 
performing various activities. 

Four schools (Baker, Blanton, Joslin, and Travis Heights) used SCE funds 
to employ aides. The aide at Baker spent most of her time in clerical 
a;:;t Lvit les. The aide at Blanton spent the greatest portion of her time 
working on videotape-related tasks, and consulting with teachers. The 
aide at Joslin spent most of her time performing clerical and instructional 
d'ities. The aide at Travis Heights was employed primarily in clerical, 
instructional, and videotape activities. 

Martin sixth-grade school used part of its SCE funds to hire a community 
representative to promote attendance of SCE students. Seventy percent of 
(.he community representative's time was spent in contacting the families 
of absent students. The remainder of his time was spent in conferences 
with the assistant principal and teachers, planning, making referrals, 
etc. Three SCE Community Representatives (and later two) were employed 
at Martin during 1976-77. Martin's attendance during 1976-77 showed a 
marked Improvement over previous years when no community representatives 
were employed. Martin hired only one SCE Community Representative during 
1977-78, and the 1977-78 attendance rate remained the same as in 1976-77. 
While it Is possible the failure to show attendance gains for the 1977-78 
school year was due to the fewer number of community representatives 
employed, it Is also possible community representative-type activities 
can only improve attendance to a certain point. 

Information concerning the reading and math practices of regular classroom 
and special education teachers was obtained through the use of question- 
naires. The findings revealed variances both within and among the schools 
with regard to materials used during instruction, organizational plans 
during Instruction, grouping techniques, average group size, frequency 
and method of assessment, and use and training in ^various reading curriculum 
systems. 

The greatest percent of teachers sampled felt there was an average need 
for mat\\ and reading workshops as compared to workshops in the other 
content areas. A total of 68% of the teachers sampled felt future SCE 
funds should be spent on the purchase of additional reading materials, 
and bh"A felt future SCE funds should be spent on the purchase of addi- 
tional math materials. Seventy-six percent of the teai'hers sampled 
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telt future SCE funds should be used to employ math teachers to work 
with set; students. Fifty-nine percent of the teachers sampled In schools 
without SCE ReadluR Teachers felt future SCE funds should be used to 
employ reading teachers during 1978-79. Ninety-eight percent of the 
teachers sampled In schools that currently employ SCE Reading Teachers 
felt future SCE funds should continue to be used for reading teachers 
during 1978-79. - 

Three of the schools (Blanton, Travis Heights, and Allan) employed a 
floating reading teacher during the 1977-78 school year, and three 
schools (Martin, Read, and Webb) employed readli.,, teachers in a lab 
setting. Major differences were found among the programs vith regard 
to materials used, organizational plans, and level of SCE student served. 

In order to assess the effectiveness of laboratory, floating, and classroom 
teacher Instruction in promoting reading achievement, a compiarison was 
made o( the gains made by SCE students who were reading on different levels 
and receiving different types of reading Instr'uctlon. Figure 1 groups 
SCE students (high, average, low) according to the reading total scores 
thoy rei:elved on the fifth-grade administration of the CAT. Since all 
SCE students are reading below the sixth-grade level, students classified 
as *Milgh scorers** are only high scorers relative to other SCE students. 
Within the high, average, and low scorers , students were further classified • 
according to the type of reading services they received during the 1977-78 ' 
school year* The average pre-posttest reading total gain in ADSS points 
Is shown for each category of students. 




10 20 iO 40 

Median Cain In ADSS Points 



Vi^wwr I. MEDIAN CAIN MADE ON THE RKADINC TOTAL SUBSCALE HY SCE STUDENTS 
KEADINC ON DIEEERKNT l.EVEl.S AND KECEfVINC DIFFERENT TYPES OF 
HEADINI- INSTKIICTION. 
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Several observations can be drawn from the data displayed in Figure 1: 

1) SCE Htudeiits receiving floating services made consistently greater 
gains than SCE students receiving laboratory services. 

2) SCE students with w or average reading total pretest scores who 
received classroom instruction made gains comparable to the gains 
made by SCE students with similar pretest scores receiving floating 
instruction. SCE students with high reading total pretest scores 
who received classroom instruction made fewer gains than SCE students 
with similar pretest scores receiving floating instruction. 

3) SCE students receiving laboratory instruction consistently made 
fewer gains than SCE students receiving classroom reading services. 

4) :;CE students with the lowest pretest reading total scores consistently 
made the greatest gains in »eading. This was regardless of whether 
the student received floai ag, ^classroom, ,or laboratory services. 

SCE students with average pretest reading total scores achieved only 
one-half the gains showed by SCE students with low pretest reading 
total scores. The fewest gains were made by SCE students with 
relative high pretest reading total scbres. 

In considering the negative gain made by SCE students with high reading 
total pretest scores receiving lab services, it should be noted only six 
students were included in the sample. A larger sample is needed before 
conclusions can be made about the achievement of SCE students in this 
category. 

In general, the data presented in Figure 1 suggest floating reading 
instruction is more likely to help SCE students make reading gains 
than either classroom or laboratory ^services. 

Tt Is difficult to assess the effectiveness of classroom instruction :Ln 
promoting SCE reading gains, due to the many types of cIl isroom instruction 
provided. In some schools, the clasproom teacher is responsible for 
teaching all the students in the class, and in other schools the teacher 
is relieved of teaching some of the students by the SCE Reading Teacher. 
In the latter instance, it is not certain if SCE students receiving class- 
room services would have made the same gains had the teacher been 
required to divide her attention among all the students in the class. 
The use of the term "classroom instruction," therefore, is somewhat 
ambiguous due to the variety of situations it represents. 

The SCE Reading Teacher at Travis Heights taught reading to one class of 
SCK students using the LOMS method. The LOMS method was developed to 
teach reading to children who are reading below-grade level in the primary 
grades. This was the first ufie of the l.OMS method with sixth-grade students 
In Austin. 



X I r . 7 



In order to assess the effectiveness of the LOMS approach, the reading 
gains made by the SCE students receiving LOMS Instruction were compared 
with the reading gains made by other fJCE students who were reading on 
the same level, but who were receiving reading Instruction from a, class- 
room teacher. SCE students receiving reading instruction from a class- 
room teacher made substantially greater gains on ach of the three CAT 
reading subscales than the SCE students receiving LOMS instruction. Due 
to the sn»all number of students receiving LOMS instruction (21), 
definite conclusions should not be drawn from this analysis. Additional 
information is needed before a true comparison of the LOMS approach and 
other Instructional approaches can be made. 

Overall, A6.A% of all the SCE students met the reading objective of .8 
gain in grade equivalents per month of instruction. A total of 5A.5% 
of all the SCE students met the math objective of .3 gain in grade 
equivalents per month of instruction. The achievement of SCE students 
in reading m 1977-78 was approximately the same as the reading achieve- 
ment of SCE students In 1976-77. The math achie^/ement of SCE students 
In 1977-78 was slightly higher than the math achievement of SCE students 
m 1976-77. 

During 1976-77, Baker had* a 7.0 hour day while the other SCE schools 
had a 6.5 hour day. At the beginning of the 1977-78 school year, Travis 
Heights also lengthened Its school day to 7.0 hours. In 1977-78, 
observations were conducted In the SCE school, with 6.5 hour days and 
the SCE schools with 7.0 hour days, so that the time each allotted 
for SCE Instructional activities could be compared. It was found t^hat 
by lengthening the school day, schools with 7.0 hour days were able 
to provide substantially more instructional time for their SCE students 
than schpols with 6.5 hour days. SCE students In 7.0 hour schools 
received a total of 23 minutes more instruction each day in the basic 
skills/major content areas than SCE students in 6.5 hour schools. Figure 
2 compares the amount of time spent in various activities by SCE ttudents 
in 7.0 hour schools and SCE students in 6.5 hour schools. One of the 
most important findings is that students In 7.0 hour schools received 
an average of two hours and two minutes of reading/language arts instruc- 
tion each day, while SCE students in 6.5 hour schools received an 
average of one hour and forty-three minutes of instruction in reading/ 
language arts each day. This means SCE students in 7.0 houi schools 
received an average of 19 minutes more reading/language arts Instruction 
each day than SCE students in 6.5 hour schools. It Is also important to 
note that SCE students in 7.0 hour schools spent less time In management/ 
mlHcellancmis activities (time spent in listening to directions, transl- 
tiona, cleaning up, class control, listening to announcements, roll call, 
etc.) than SCE students In 6.5 hour schools. SCE students in 7.0 hour 
vschools spent an average of 7 A minutes every day in management /miscel- 
laneous activities, while SCE students in 6.5 hour schools spent an 
avciige of 82 minutes in such activities. These findings suggest SCE 
students In 7.0 b shcools are receiving more Instruction and spending 
less time In m/jnagement/mlscellaneoua activities than SCE students in 
6. !) hour schools. 
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Data t rom th^ 1976-77 State CoTTipenaatory Education Final Technical Report 
rovealH [ CL and non--SCE students received esbi^ntially the same amount 
of Instruction in reading/language arts, math, social studies , science, and 
art during 1976-77, There was no more than three minutes difference in 
tht' amount of Instruction SCE and non-SCE students received in each 
subject area. Data from 1977-'78 observation reseatch, however, reveals 
SCK and nou-SCK students received different amounts of instruction in 
1977-78 in several areas, SCE students in both 6.5 and 7,0 hour schools 
received a substantially greater amount of instructional time in science, 
and less instructional time in social studies than did non-SCE students. 
SCE students in 6,5 hour schools received more instructloni 1 time (8 
minutes) in math than non-SCE students In 6.5 hour schools. SCE students 
In botli 6,5 hour schools and 7.0 hour schools received slightly more 
Instructional time in reading/language arts than did non-SCE students, 
and subsLautially more instructional time in art than non-SCE students. 
Th^ise findings suggest instructional time in 19/7-78 was uaed differently 
for SCE students than It war* used for non-SCE students in several ways. 

In ^enoral, SCE students in 1977-78 received more instruction in reading/ 
language arts than SCE students in 1976-77. Little difference was found 
in the amount of math Instruction received by 1976-77 and jl977-^8 SCE 
students, SCE students in 1977-78 received less Instruction in social 
Studies than SCE students in 1976-77, and more instruction in science. 
SCE students in 1977-78 spent significantly less time in management/ 
miscellaneous activities than SCE students in 1976-77. 

Twelve SCE funded workshops were conducted during the 1977-78 school year. 
Of the six most highly rated workshops, five were concerned with 
curriculum planning and/or introduction of materials. Only two of these 
six workshops were conducted by consultants. Both of these workshops 
addressed specific problems identified by the workshop participants. 

The total cost of the SCE Basic Skills Component for the 1977-78 year 
as reported In the Annual Evaluation Report to TEA was $164,527. 



Dec I s ion Que stion; Sh o uld the role of SCE Coordinator/Supervisor be 
CO nj: I n u ed in its pres ent form ? 

Information obtained from observation of the SCE Coordinator/Supervisor 
and Inter views conducted with the Director of Developmental Programs, 
tlio Educational Planner, and the SCE Coordinator/Supervisor Indicate 
the duties of the SCE Coordinator /Supervisor include: assuming 
responsibility for the SCE budget; processing purchase* requisitions; 
writing the SCE ai)plication to TEA; writltig SCE amendments when neces- 
sary; working, with the Compensatory Planners; helping design and Imple- 
ment summer school activities; visiting sixth-grade schools and documenting 
program activities; handling SCE personnel appointments in SCE schools; 
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coi>td tnat luK the activities of sixth-grade achoola with the activities 
of other district departmentH; and handling office management concern.8.> 



The Director of Developmencal Programs would like .0 see the SCE 
Coordinator/Supervisor take more of a leadership role next year in coor- 
dinating the work of the Compensatory Planners. The Director of Develop- 
mental Programs said she would also like to see thi SCE Coordinator/ 
Supervisor supervising the SCE campus staff in a manner comparable to that 
supervision performed bv the instructional coordinators. The SCE 
Cnordlnator/Supervlsor feels It is important to synchronize his activities 
with those of the Instructional coordinators, and would like to spend 
more time in the schools in the coming year. 

Two of the SCE principals did not know what the responsibilities of the 
SCE Coordinator/Supervisor were, and so did not know whether the respon- 
sibilities associated with the position should be altered. Four SCE 
principals felt the SCE Coordinator/Supervisor's responsibilities should 
remain the same for the 1978-78 school year. Two of the principals felt 
the SCE Coordinator/Supervisor should be responsible for coordinating 
local campus programs, but should aot be responsible for evaluating 
SCF. school personnel. 

Deci sion Question; Should the proposed curriculi im documents be con sidered 
f o r^ J. mplementatinn ? 



The SCE curriculum writer developed two books to be used as a third-grade 
multlsensory curriculum guide to teach reading and language arts skills 
to educationally disadvantaged students. In addition to completing the 
stated objectives, the curriculum writer produced other LOMS-related 
materials, provided feedback for teachers using the LOMS directives, and 
conducted in-service LOMS training sessions. 

Curriculum guides for reading in the content area of science were produced 
for students In grades K-b. Curriculum guides for raading in the content 
area of health were produced for students In grades 

The fjocuments produced Ln this component were examined for completeness, 
and will receive further evaluation as thoy are Implemented In district 
sc'hools • 

The total cost of the SCK Elementary Curriculum Development Component 
tor the 1977-/H veat as reported in the Annual Evaluation Report to TEA 

was $2(),250. 

A high school tutorial rnrrlci]lum was completed and was t leld tested on 
one s(^hoo) campus during the third quarter of the school year. 

A liuilor high school tutorial curriculum was also d'-weloped and will l^e 
t lt^d tested In a Junior hU;h summer school program. The results of 
the field testing will he ri'Vlewed and anv necessary changes will then 
hv mailiv. 

The total » oi I lu' rransillou Uutrlcuhim Oevt^lopment Componrnt In 
U>7/'/H a: irpoiiiMl 111 the Annual Report to T\'A was 
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Peel 8 Ion Questio n; Sho ul d parenta l I nvolvement a ctivltlea be included 
aa a stru ctu red feature of the SCE proyam? If so, what general direc - 
tion should It take? 



Although much research has been done concerning parental involvement in 
education, most studios have focused on the preschool yearsi and to some 
extent the first few years of elementary school* While there is strong 
evidence that certain types of parental involvement activities facilitate 
achievement, improve attendance, and enhance self-concept at these early 
ages, little is known concerning the effect of parental involvement upon 
the behavior of sixth-grade students. Even less is known about the effects 
of a parental involvement program in schools where students are bussed. 
As a result, more research is needed before conclusions can be drawn 
concerning the probable success of a parental involvement program in 
sixth-grade schools where students are bussed. 

In the meantime, each SCE principal was asked if a structured parental 
Involvement program was likely to be successful in the sixth-grade schools* 
^^fhile all of thi» sixth-grade piTincipals would appreciate greater parental 
Involvement In the sixth-grade schools, none of the principals felt 
structured SCK parental involvement activities were likely to be suc- 
cessful. One principal stated SCE parental activities should not be sepa- 
rated from non-SCE parental activities, in that this would create antago- 
nistic feelings between the two groups of parents. Several principals 
stated the heavy reliance on bussing caused parents to be located through- 
out the city. This makes it difficult to develop a feeling of school unity, 
as well as making it harder for parents to find transportation to the 
schools. All of the principals stated many of their students come from 
one-parent homet^, homes in which both parents work, or homes in which 
the parent (s) holds more than one Job. This means parents have trouble 
finding time to attend school functions. All of the principals said their 
schools' parental involvement activities were hindered by the short period 
of time the students were in the sixth-grade schools. 
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Publication No. 77.68 
(Technical Report) 



AB STRAC T 

Title; State Compensatory Education 1977-78 Technical Report 



Contact Person; Patsy Totusek, Paula Matuszek 



No, Pages : 486 



Sununary ; 

This Is the accompanying document to the State Compensatory Education 
1977-78 Final Report (see Final Report in this volume). 

The Technical Report consists of 22 appendlct.^i. Each appendix reports 
the Information collected by a specific collection measure. 

Each appendix contains: 

An instrument description 
Purpose of the measure 
Procedures used to collect the data 
Summary of results 

Tables and figures presenting the data 
This technical report contains the following appendices: 



Appendix A 
Appendix B 
Appendix C 
Appendix 
Appendix 
Appendix 
Appendix 
Appendix H 
Appendix 
Appendix 
Appendix 
Appendix 
Appendix M 
Appendix N 
Appendix 0 
Appendix P 
Appendix Q 
Appendix R 
Appendix S 
Appendix T 
Appendix IJ 



Pupil Activities Record (PAR) 

California Achievement Test 

Educat.onal Planner Interview 

Director of Developmental Programs Interview 

SCE Coordinator/Supervisor Interview 

SCE Coordinator/Supervisor Observation and Running Interview 

SCE Aide Questionnaire 

SCE Principal Interview 

Workshop Evaluation Scale 

Videotape Tally Sheet 

SCE Community Representative Diary 

SCE Community Representative Interview 

Classroom Teacher Reading Questionnaire 

Classroom Teacher Math Questionnaire 

Special Education Teacher Reading Questionnaire 

Special Education Teacher Math Questionnaire 

Classroom Observation Reaction Form 

SCE Reading Tear.her Interview/Observation 

Martin Slxth-Gride Attendance 

SCE Community Representative Monitoring Form 

SCE School Chriracterlstlcs 



Information In these appendices is summarized In the Final Report for 
this project* 
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Publication No. 77.46 
(Intarlm Raporc) 



ABSTRACT 

Title : Analysis of the 1977-78 CAT Scores for SCE Identified Students 
Contact Person : Patsy Totusek 
No. Pages: 7 



Sunmary : 

This report previews the statistical procedures that will be used to 
analyze the OAT scores of students participating in the 1977-78 SCE 
program. The report la intended to be used as a reference document, 
to help in interpreting the CAT scores for SCE students at each sixth- 
grade school, and for all sixth-grade schools combined. 

The same format is used throughout the report to explain each of the 
analyses. This format involves: 

a) A statement of the evaluation question for which the analysis 
La relevant; 

b) A copy of the table that will be used to report the results; and 

c) Any explanations which may be needed to interpret the table 
correctly. 



Publication No. 77.31 
(Interim Report) 



ABSTRACT 



Title: Needs Assessment for the Preparation of 1977-78 Application^! for 
Compensatory Education Programs 



Contact Person; Paula Matuszek, Joy Hester, David Doss, Patay Totuaek 



No. Pages ; 722 



Summary: 



The seventeen sections in uhis needs assessment are: 



I, Introduction , A rationale for needs assessment is accompanied by a 
brief overview of the nature of this publication. 



II • School Characteristics.: Enrollment » percent attendance, percent low 
income, and ethnic distribution are given for the past five years for 
all A.E.S.D. schools. 

Ill, Study of School Costs . Grant costs and other information relevant 

to the question of distribution of resources among schools is given. 
This information was prepared by the Department of Finance for pre- 
sentation to the Board of Trustees. It is included in this report 
In order to make tt more accessiblct to planners. 

IV. Family Survey^ Low SES and Minority Student Achievement Study , A 
survey of a sample of families in Austin that had either second or 
fifth grade students attending Austin schools was undertaken by the 
Low SES and Minority Student Achievement Study in 1977. Some of the 
preliminary results of this survey are included here. These results 
show by ethnicity .... 



1 
2 
3 
A 
5 
6 
7 
8 
9 
10 
11 



Percent of Male Head of Household Working 
Percent of Female Head of Household Working 
Level of Education of Male Head of Household 
Level of Education of Female Head of Household 
Percentage of Students Having Preschool or Daycare 
Percentage of Students Attending Kindergarten 
Percentage of Students Attending AISD Kindergarten 
Percentage of Students Changing Schools in the Past Year 
Number of Different Schools that Student Has Attended 
Parents* Rating of How Student is Doing in School 
Parents' Ratings of the School that the Student Attended 
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12) Amount of Education Parent Would Like to See Student Get 

13) Yearly Family Income 

V. Literature Reviews, Because it is always important before embarking 
on new educational endeavors to see what results have been recorded 
for similar endeavors in other situations, the following areas of 
interest are summarized in literature reviews. 

1) Sibling Tutoring 

2) Parental Involvement and Sixth Graders 

3) Summer School for Low SES Students 

4) Math Programs for Low SES and Minority Students 

IV. Language Dominance Information. Information in the following categories 
is given by grade level and school for all K-5 Elementary campuses. 

1) Number of English dominant children 

2) Number of Spanish dominant children 

3) Number of bilingual children 

4) Number of children for whom more information is needed 

5) Number of children for whom both scores were low 



VI r. Overlap Studv: The Number of Students Served by Multiple Programs . 

An ongoing concern of personnel involved with special programs has 
been the overlap of services being provided to some students. In 
an effort to document the extent of this overlap, ORE conducted an 
overlap study in 1976-77 which defined the groups of students being 
served by each of the many possible combinations of special programs. 
The results of that study were sufficiently enlightening to encourage 
a repetition of that effort in 1977-78 in order to determine the .amount 
of overlap that might continue to exist. The results of the recent 
study are included here. 

VIII. Achievement Levels ; This section summarizes the scores obtained by 
A.I.S.D. students on four tests: 



1. ) Boehm Test of Basic Concepts 

2. ) Metropolitan Readiness Test 

3. ) California Achievement Test 

4. ) Sequential Tests of Education Progress 



rx. Title I Summer School. A comprehensive review of the results of the 
evaluation of Title I summer school ia reviewed here. This information 
should prove useful to planners of summer school in general and Title I 
summer school in particular. 



^* Title I Parent Questionnaire . \ short questionnaire wavS mailed to 
a sample of parents of Title I students in October of 1977. This 
chapter outlines their respones. 
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XI, Identification of Title I Students , Procedures and criteria for 

Identifying Title I students are outlined, and a study of the lists 
Is discussed. This study shows the percentage of students on 
each campus who were Identified by teat score and those who were 
identified by school recotmnendatlon. It also prints out the 
percentages of students who were identified for services even 
though their test scores were higher than the scores stated in 
the criteria » as well as the percentages of students who were not 
identified for services even though their scores were low enough 
to automatically qualify them for services. The percentages of 
students without any test scores at all are also noted. 

XII, Title I Nine Week Reports . Nine week report forms are completed by 
the Title I counselor, community representative, and instructional 
personnel on each Title I campus. Two types of summaries of the 
these reports for the fijrst nine week period are Included here: 

1) A general summary for each campus which shows the number and 
percentage of students served by Title I Instructional 
personnel, the community representative, and the counselor. 

2) Detailed school summaries for counselors and community 
representatives which show the activities that are Included 
under the larger categories in the gener£l summary. 

Separate chapters address the following areas of the Migrant Program in 
A.I.S.D. 

XIII, Austin's Migrant Students: Where They Attend School, 

XIV, Austin's Migrant Students: What Is The 2ntry Achievement Level 
of the Pre-Klndergarten Students? 

XV, Austin's Migrant Students: At What Level Are They Achieving? 

XVI, Austin's Migrant Students: What are Their Health Needs? 

XVII, Austin's Migrant Students: What Other Supplementary Programs Are 
Serving Them? 
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ABSTRACT 

Title; State Compensatory Education Program (1977-78) Evaluation Design 



Contact Person; Patsy Totutek, Paula Matuszek 



No> Pages : 21 



Content: 

The evaluation design is a one-year plan of evaluation work for the 
project. The table of contents for this document includes; 

I, Evaluation Design Review Form This chapter presents the names and/or 

signatures* of persons (responsible for 
some aspeqt of the project *s implementa- 
tion) who . have been provided relevant^ 
portions of the design for review and 
comment • 

II. Decision Question Here the evaluator states all the decision 

A. Questions Addressed questions and relates them to the evaluat/Lou 

Overview questions and objectives (and their data 'sources) 



III. Narrative Summary 

A. Program Summary 

B. Evaluation Summary 



This chapter briefly describes the project and 
the evaluation activities tied to the 
project. 



IV. Information Sources Summary 



The principal evaluator provides work 
estimates (in persons-days) for each 
person on the evaluation team. Work 
estimates are projected for each 
"information source" and are broken 
into the four types of evaluation tasks : 
development^ collection, analysis, 
and dissemination. 



V, Summary of Data to be 
Collected in the Schools 

VI. Evaluation Time Resources 
Allocation Summary 



This is a timeline for the collection 
of data in the schools. 

This chapter summarizes all the evalu- 
ation work estimates (in person-days) 
by position, for each aspect of the 
evaluation. 
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E valaation Desi^tn Summary : 

Evaluation of the 1977-78 SCE program involves two major activities: 

a) The production ot a Final Report and a Technical Report which 
present information relevant to the decision questions; and 

b) The production of an Annual Evaluation Report for TEA which 
documents the extent to which program objectives have been 
achieved. 

These activities require the collection of needs assessment, process, 
and outcome data. 

Needs assessment data will be used to identify the needs of SCE principals 
in planning local campus programs and working with district and SCE 
staff personnel. The number of students eleiglble for SCE services 
will be determined, and rosters listing the names of SCE students will 
be distributed to the schools. 

Process data will be used to analyze the extent to which program objectives 
have been implemented. Interviews, questionnaires, observations, and 
diaries will be used to collect information concerning: 

a) The classroom activities engaged in by SCE and non-SCE students; 

b) The organizational plans and instructional strategies used 
by SCE Reading Teachers; 

c) The services performed by SCE Aides; 

d) The attendance improvement activities conducted by the Martin 
Community Representative; 

e) The videotape activities performed in the SCE schools; and 

f) The typical activities engaged in by the SCE Coordinitor/ 
Supervisor. 

Several types of outcome data will be collected. Scores obtained on 
the California Achievement Test will be used to assess the impact of 
SCE activities upon student achievement in reading and math, and the 
documents developed by the Compensatory Planners will be examined for 
completeness. Since many of the tasks assigned to the Compensatory 
Planners will not be completed until late In the year, a mor^. compre- 
hensive evaluation of their work will be postponed until a later date. 
The Workshop Evaluation Form will be administered no participants of 
SCE workshops, in order to assess the training received. 
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Sco9% of D««ign ; 

6 D«cl8ion qutsdons (Systaa level and program level) 
32 Evaluation questions 



Evaluation Resources Required (la person-days) ; 

S.2S Coordinator 

8.5 Senior Evaluator 

174 Evaluator 

108 Data Analyst 

162 Evaluation Assistant 

127 Secretary 



FINAL REPORT 



Evaluation Findings on ; ESAA iasic, 1977-78 
Contact Person ; Myron Friedman, Paula Matuszek 



The prevailing policy of the Office of Research and Evaluation is to 
undertake evaluations only on these programs which provide evaluation 
resources at a level permitting the production of information adequate 
to make decisions about the program. The office maintains that an inade^ 
quat^. evaluation may be of less value tium no evaluation. In the case of 
the ESAA Basic and Pilot programs, the level of funding is far below that 
recommended. The ESAA Basic program budget for 1977^78 was $278,236. 
The evaluation budget for ESAA Basic for this time period was $5,400. 
The evaluation budget for ESAA Basic thus represents only 1% of the 
program budget. These levels were insisted upon by ESAA funding sources. 
Although thi3 level of funding is hardly adequate for cai*rying out an 
evaluation, ORE had no option in this matter. This was obviated by the 
ESAA requirement for assessing the attainment of program objectives. 
The Office of Reaeai^ah and Evaluation, therefore, has been forced to 
ijonduct an evaluation far below our usual standards. 



Sunimary of Evaluation Findings : 



Description of the Program: 

The Emergency School Aid Act (B'SAA) appropriates Federal funds yearly co 
Basic (desegregation programs) and Pilot Programs (compensatory and/or 
research programs). The AISD, ESAA Basic Project Includad three components 
in the 1977-78 funding year. The three components included the Secondary 
Communication Skills and Staff Development Project, the School-Community 
Liaison Program, and the Student Action Project, The Sf..iondary Communi- 
cation Skills Program has now completed its fifth year of operation. 
During this funding year, its services were twofold: individualized 
tutoring of reading skills and staff development. The program provided 
individualized tutoring of reading skills for students in grades seven 
through twelve on 18 secondary campuses (0. Henry and Murchison Junior 
Highs were not included in this year's projiiram) . Tutoring was provided 
by ESAA Reading Specialists on each of the 18 participating campuses. 
The program provided staff development in instructional techniques and 
multi-ethnic concepts. 

Three Staff Development Specialists were responsible for organizing, and 
Implement ins Inservice workshops, classroom demonstt'ations and diirplays 
of instructional material on individual campuses and on a District-wide 
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b^isis. In atldltion, a reading, math and career awareness program wa' 
implemented by m ESA^ Reading-Math Specialist at St. Mary's Parochi 
School. 



The second component of ESAA Basic, the School-Community Liaison Program 
has now completed its 5th year of ESAA funding. The services of the School- 
Community Liaison (lJCL) Program were directed toward student workshops 

human relations, staff training in desegregation problems, leadership 
training programs, and various community activities. The School-Community 
Liaison Representatives (SCL Staff) divided their time between working 
with indivxdual schools aiA working with one of the major task groups 
directed toward prograra goals (workshop design; service to individual 
students and parents; Trilogy, a tri-ethnic rirama group designed to 
demonstrate the dynamics of interpersonal multi-ethnic relationships). 

The third component of ESAA Basic, the Student Action Project has now 
completed its 5th year of funding. Fhe specific ^oal o^ the Studert 
Action Project wps to increase "minority participation in secondary 
level student activities by removing barriers which impede participation 
in student activities." During this funding year, the services of the 
Student Action Project (SAP) were directed toward goals: 1) developing 
co-curriculum clubs in the areas of creative writing and reading. on two 
secQodary campuses: 2) increasing minority participation districtwide in 
student clubs and activities; 3) providing orientation sessions for two 
sixth grade schools to help students become more aware of opportunities 
for participating in clubs and other student activities at junior high. 
The program was implemented by the SAP Coordinator n id Student Activity 
Contact Persons and by Club sponsors at each secondary campus. 

The evaluation findings wilJ. be summarized separately for each component 
of the ESAA Basic Project. Relevant evaluation findings will be reported 
for ea:h component's Decision Questions. 

Secon dary Communication Skills and Staff Development Project 
D ecision Questions : 

Should ESAA Basic Secondary Communication Skills a nd Staff Development 



Project be refunded for an additJ.unal year ? 



Should the Secondary Communication Sk il ls Prq&ram Staff Development 
Component be roaintalned for an additional year ? 

^1211 Id the Seconda r y Communication Ski l ls Progr:am utilize only individual 
tutoring (as op posed to teaming in the classrooms) in the instru cti o nal 
progr jtm? 

Should the Secondary Coflmiunication Sk i lls Pro[>ram focus its Inscructlonal 
pro gram on a specified target group ? 
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Six objectives were lis'-ed for ohe 19/7-73 Secondary CootnunicaCion Skills 
Compinanc. Three objecclves were complecely' accained. The fiist objective 
which was actainad, specified chac 60 % of a 5Q% aamplftot the secondary 
teachers who participated in the staff development activities will indicate 
that thay received useful traininjs and have knowledge, of the instructional 
■■'■ontent of the traininjj . More than 60% of the teachers responding to a 
Teacher Questionnaire indicated that they received useful training. 
Furthermore, 77*: of the tea:Uers r3s;ponding indicated that th.e materials 
and ideas received from the ESAA Staff Development have had a significant 
impact upon student learning and the behavior of students in their class- 
rooms. The overwhelming majority of teachers responding indicated 
that the program is needed and that it is not merely a duplication of 
services offered by other programs. Although the majoriuy (93%) of the 
teachers responding indicated that the program is needed, a large number 
of teachers (71%) indicated that iranrovement is needed. On?, identified 
area f.^ir improvement is in publicizing the content of training available. 
More, than 50% of the teachers responding Indicated that they W'-vre rtot 
fully aware of the Staff Development off rings in the areas of management' 
techniques and multicultural awareness. 

The second objective which was attained specified that 507> of St. Mary's 
6th, 7th: ■^nj, Stb graders will show an av e rage gain in reading achievement 
equal Co .3 tn onths '^ain for ea^h -ponth of instruction . Fourteen stude'nts 
at St. Mary'o parcicipac?-d in the reading tutoring program. Fifny-seven 
percent (3 staden'-is) met the specified criterion. 

The chird objective which uas accained specified that 50% of a 15% ■ sample 
of the identified student^ oartlcipaClng ia the tutoring program will 
demonstrate improved reading ability equiva-lent to ,8 months g<:in per 
one month of instruction , 

A total of 2,114 students on 13 .secondary * campuses participated in the 
readin^-tutorin>5 program. Overall, 52.3% of a random samnle (sample 
size * 130 scudwcs) of students met the criterion* There vas only a 
slight differencfe between the percentages of junior high and senior high 
students who met the criterion. At the ^junior high .level 51.2% of the 
.itudents met the criterion. At the senior high level 54.2% of the 
snudents met the criterior. . The ESAA Reading Specialises worked "with 
students in one of t;^*. 3ettir4g3, Some students received individual 
tutorii:.g in a ta toring center, other * students received Individual tutoring 
and classroom instruction in teaming situation (ESAA Specialist teamed 
with classroom teacher). Students iu a tutoring center appeared to spend 
more time in 'dire:ct instruction of reading than students in a teaming 
.-situation. Although teaming studerts appareatly received zhe same amount 
of instruction time per week (approximately 2^5 hours), more of their 
instruction tima may have been spent in assistance in specific content 
material, rather than direct instruction in reading. 'Whatever apparent 
diflrarence there may have been between the two approaches to tutoring, 
there were, no .^i.;nif icant differences in the ef i.ectiveness of the tw 
ipprojchchi. In che. beaming .'^ir.uation 31.3% of the students met :he 
objective* In the tutorin^^ Ucuation .)6.4:; of the students met the 
ob j oxtlve. 
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ime objective was only partially attained. This objective specified that 
60% o£ a 15% sample of the identified students participatint s ; in the tuto r- 
i ng prot^ram will have a higher gr^ ^ e point average for the third quarter 
than for, the first quarter in the content areas of social studiea, language 
arts, 3cienc;ei and math > 

A total of 2,114 studeuLS on 18 secondary campuses were reported .i'} having 
participated in the reading-tutoring program. Overall . A7% of a random 
sample (sample size - »349 students) of the student? met the specified 
criterion. There was only a slight diflference between the percentages 
of junior high and senior Wigh students who met the criterion. 



Tv^ objectives were not attained. One of these objtictives specified that 

50 ^ of St . Mary's 6th, 7th, and bth graders w ill show an average gain 

In math achievement equal to .8 month gain for each month of instruction • 

Twenty--. H Ae students at St. Mary's participated in the math tutoring 
prograp.' Improvement from preD'est to posttest was evident for 57% of 
the students. \ However, only 38% (11) of the students met the criterion 
\)f .8 month ga^'n lor each month of instruction. 

The second objective which was not attained specified that studenus in 
Che 6th, 7th', and 8th grades at St. Mary's will on the average show a 
si giijif leant gain" in their knowledge of careers . Students in grades seven 
and eight did increase their knowledge of careers, based upon a Student 
Career Questionnaire completed by St. Mary's students. However, the increase 
from pretest to posttest was not at^ a significant level for any of the 
three grades. 

St u4ent Action. Program 
Decision Questions : 

Sliould, E'SA/y Basic: Student Action Project be retunded f or a n addltioual 
year ? 

Should the type of activities offered by t-h e Student Action P roject be 
m odified ? / 

Three objectives were, listed for the 1977-78 Student Action Project, 
"w^^objectives were completely attained. The firsc completely attained 
objective stated that t here will be a 100% increase In the number of 
academic clubs in the areas of reading and c reat i ve writing in both of^ 
th^ participating senior high schools . This was interpreted to mean 
that two new clubs would be established at each hjv!;h school. The two 
clubs were established at Austin and McCjiium Hiv;h S(*hools. 
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Th« obJ«ctive has no stated criteria aa co tha mambarship of cha clubs, 
tha fxtaac and natura of Its accivicias, or cha excanc of mambara' 
purticipacion in cha clubs. In viaw of tha SAP's broadar goa? of increas- 
ing ainoricy participation in school accivitias it Is Intaraating to nota 
that ainority studants constituted 30Zof tha Raading club and 137. of the 
Writing club at McCallum High. JUnority students (1) constituted B% of 
tha Writing club at Austin High. 

Tha second objective which was completely attained stated that 50% of the 
students in a random sample of classroona in each of the two pnrticipatinn 
schools will be able to name ac leaat one student activity and defi ne 
its purpose . The Student Action Project Coordinator distributed Student 
Activity Handooks to all sixth grade students via their school counselors. 
Students in a random sample of two claaarooma at Webb and two sixth grade 
classes at Allan Junior High completed a brief questionnaire prior to 
tha distribution of the Student Activity Handbooks. B«ied upon this 
precast, mora .than 50% of 'the studants in the sample at Webb already 
aet the objective. At poatteat (readministration of Questionnaire aftar 
students received the Handbooks) tha objective waa oat at both schools. 
Ail four claasea showed improvement from pretest to poattest. This increase 
Is an indication chat tha Student Action Project may haVe bean successful 
tn providing sixch grade scudenc? wich information abouc school clubs 
and actlvicies. 

The chird objeccive scaced thac minoricy scudent participacion. in scudenc 
accivicias will increase on a district-wide basis at leaat 30% over their 
participation in 1974 . " '"^ ' ] 



:he ob.j'2azive has bee.n mat ov 'Exceeded in the following five categaries 
':f Jiuba: 



Gain Needed 
to Meet Objective 



Actual Gain 




Or' nastra 30% 1407. 

Junior Histcrlans iO% 106^ 

Pi blications 307, 112% 

Drama 30% 61% 



The ob.i 'Motive ^jas not met in zhe followvng ,"''>■■ Savegoviea of cluba: 



Gain '^oo^tii 
to Mit'.ttt Ob <.-.ccive 



Actual Gain 



Chorus 



30% 
30% 



10% 



Human Relation-^ 



Pep Squad/Drill Team/ 



Cheerleaders 
Student Council 
'/ocaCional Clubs 




27% (decrease) 

7"/ 

15% (decreaae) 



lunior .md Senior Hi'^h SchooL-5 werii equally et t'ective/ tniU* teccive in 
neetlu^ t:hiii objective- 



School-Conanunlty Liaison Program 



Decision Questions ; 

Should ESAA Basic; School Community Liaison Program be refunded for an 
additional year ? 

Five objectives were listed for the 1977-78 School-Community Liaison 
(SCL) Program. Two objectives were completely -^.ttalnedt The first attained 
objective specified that 50% of a 5^ sample of assisted ^rents will ' 
make statements which Indicate that contact with the SCL prograte Improved 
their problem's resolution . An overwhelming majority of the parents 
responding to a telephone Interview Indicated that their contact with • 
SCL Improved their problem's resolution. Furthermore, 90% (sample 
responding ■ 11) of the parents responding indicated that* they could now 
handle situations with the school on their own better than they could 
before working with SCL. 

AIL of the parents who responded also indicated that they would again 
approach the SCL representative for assistance and would also recommend 
that other parents go to him/heif for help. 

The second completely attained objective was based upon student responses 
to an Jnterethnic Behavior Scale. The scale was designed to assess the 
extent to which students of different ethnic groups related with one - 
mother in various school situations. This objective specified that 20% 
)f a 2% sample of secondary school students will report participation 
i n one or more SCLR activities. On the average, the measure of inte r- 
ethnic behavior will be higher for those reporting participation than 
for those not reporting p^articlpatio n. The Interethnic Behavior Scale 
was administered in May 1978 to a random sample of junior high and 
senior high social studies classe'" . Fifty-two percent of the students 
In the sample (124 students responded to the questionnaire items) reported 
participation In one or more activities on their campus which had been 
sponsored in part or In whole by the SCL Program., theste two groups of 
students (those who reported having participated in SCL sponsored 
activities vs. those who had not participated) were compared oft the 
basis of their average responses to the Interethnic Behavior Scale. 
Overall, the average response of SCL Activity participants was higher than 
the mean for nonparticipants. This might be interpreted to mean that 
through contact with SCL Activities, students in the sample Increased 
the frequency by which they interact within the school setting v;ith 
students of different ethnic backgrounds. 

The other three objectiv»'3 were either ^a^tially attained or almost 
cumplately attained. The second objective based upon the Interethnic 
Behavior Scale specified that 70% of a 25% sample of the members of the 
Stud ent Advisory Committee and 50% of a 25% sample of the Student Human 
Rel^rt ion s Committee will achieve increased scores on a measure of Inter - 
o Thnlc B e h'ivlor . The School-Community Liaison Representatives worked 
directly with the Human Relations Committees and Student Advisory Cii imittees 
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on many of the secondary campuses. The nature of this work ranged from 
serving as advisors in discussion groups to sponsoring leadership train- 
ing and student workshops in human relations. Samples of these two 
groups of students completed the Interethnic Behavior Scale Ln Fall 
1977 and again in May 1978. There appeared to he no significant differences 
between the percentage of Junior high and senior hiph school students 
who improved their scores from pretest to poettest. Overall, 53.7% 
(N » 304) of the Human Relations Committee members improved their scores 
on the Interethnic Behavior Scale, therefore, this part of the objective 
wiS met. Although 57% of the Student Advisory Committee members (N - 
32) improved their scores, this percentage fell short of the criterion 
specified in the objective. Therefore, the objective was only partially 
attained. 

the last two objectives related to Trilogy, the tri-ethnic drama group. 
One of the objectives specified that 50% of a random sample of the Trilogy 
Audience members will be able to; 1) state in their own words two goals 
of Trilogy, 2) indicate on a list of Trilogy goals -that at least 30% 
of the stated goals were m et , for them at that performance . Trilogy 
performances were held throughout the year at various AISD secondary 
campuses and several community locations • Audiences at more than ten 
Trilogy performances were requested to complete a questionnaire immediately 
following the perf oinnance. More than 77% of this sample of Trilogy Audience 
members indicated that the goals have been either somewhat or completely 
met. However, only 25% of the Audience members were able to correctly 
list two or more Trilogy goals. 

The second objective relating to Trilogy specified that 10% of a 2% 
sample of the Secondary students and 75% of a 25% sample of the Huma n 
Relations Committee members will be able to; 1) state in their own 
words two goals of Trilogy, 2) indicate on a list of Trilogy goals that * 
at least 30% of the stated goals had been met for them . 

i)verall, 56% of the sample of secondary students (same sample that responded 
to the Interethnic Behavior Scale, N « 124) and 82% of the Human Relations 
Committee, members (N - 304) stated that the Trilogy goals were at least 
somewhat met for them. Overall, 14% of the sample of secondary students 
were able to state at least two , goals of Trilogy; however, only 24% 
of the Human Relations Committee members wera able to state two goals. 
Because this percentage fell short of the 75% criterion speci^'l^.d in 
the objective, this objectiv-^ was only partially attaire^^' 
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(Technical Report) 



ABSTRACT 

Title: ESAA Banlc - 1977-78 Final Technical Report 



Contact Person: Myron Friedman 



No, Pages : 235 



Summary : 

This la the accompanying document to the ESAA Basic Final Evaluation 
Report. 

Each appendix contains; 

An Instrument description 
Purpose of the measure 
Procedures used to collect the data 
Summary of results 

Tables and figures presenting the data. 
This technical report contains the following appendices: 



Appendix A: 
Appendix B: 
Appendix CI 
Appendix D: 
Appendix E: 
Appendix F: 
Appendix G: 
Appendix H: 
Appendix I: 
Appendix J : 
Appendix K: 



California Achievement Tefit (Reading Only) 
Grade Point Averages 
Teacher Questionnaire 

CalAfornla Achievement Test (Reading and Math) 

Studeru Career Questionnaire 

Interethnic Behavior Scale 

Student Activity Questionnaire 

Parent Telephone Interviews 

Trilogy Audience Questionnaire 

Club Records 

Student Activity Membership Report 



Information in these appendices is suminarlzed in the Final Report 
for this project. 




Publication No. 77.16 
(Evaluation Design) 



ABSTRACT 



Title : ESAA Basic Evaluation Design (1977-78) 



Contact Person; Myron Frleduuin 



No, Pages ; 17 



Content: 

The evaluation design is a one-year plan of evaluation work for the 
project. The table of contents for this document Includes: 



I. Evaluation Design Review Form 



II. 



III. 



This chapter presents the names 
and/or signatures of persons 
(responsible for some aspect of 
the project *s implementation) who 
have been provided relevant por- 
tions of the design for review and 
comment. 

Decision Questions Here the evaluator states all the decision 

A. Questions Addressed questions and relates them to the evaluation 

B. Overview questions and objectives (and their data 

sourcas) . 



Narrative Summary 
A« Program Sunmary 
B. Evaluation Summary 



This chapter briefly describes the project 
and the evaluation activities tied to the 
project. 



IV. Information Sources Summaxry 



V, Summary of Data to be 
Collected in the Schools 

VI, Evaluation Time Reyources 
Allocation Summary 



The principal evaluator(8) provide 
work estimates (In person-days) for 
each person Oi the evaluation team. 
Work estimates are proj footed for each 
'information source'' and are broken 
into four types of evaluation tasks: 
development, collection, analysis, and 
dissemination. 

This is a timeline for the collection 
fo data in the schools. 

This chapter summarizes all the eval- 
uation work estimates (in person-^days) 
by position, for each aspect of the 
evaluation. 

f 
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Evaluation Design Summary ; 

The primary focus of the 1977-1978 ESAA Basic Evaluation is on the extftrc 
to which each component program met its stated objectives. An addi- 
tional focus is upon an evaluation of the effectiveness of specific 
program activities in meeting their objectives. Information regarding 
the programs will be collected and presented in the areas of Studtuat 
Performance, including achievement scores on the California Achieve- 
ment Test and Grade Poir^ Averages; Student Participation in program 
activities; Teacher and Parent responses to specific program components. 



Scope of Design : 

3 Decision Question (Level; Office of Education, Program) 
3 Evaluation Questions 



Evaluation Resources Required (in person-days) ; 

1 Coordinator 
A Senior Evaluator 
43 Evaluator 



FINAL REPOR^ 



Svaluacion Findings on : ESAA Piioc, L9 77-73 
Goncacc Person: Myron Friadman, Paula >iacu32ek 



Thft prevailing policy of :^ha Office of Research, and evaluation is to undar^ 
zaki •Bvaluationa only on ihoaa pvogrcana which provide evaluation resources 
■It c level permitting ':he production of information adequate to make deci^ 
sions 'znout zhe progran. Tne office maintains that -zn inadequate evalua^ 
vion may be of less value than no evaluation. In the case of the ISAA 
Basic and Pilot programs, the level of funding is far below that secom^ 
mended, The ESA^i Pilot program budget for 13??'13?S 'jas $130,346. The 
-ivaluatian budget for ESAA Pilot was $2B00 through March 32, I3?d. A 
program budget revision at zhat time increased the ESAA Pilot evaluation 
budget zo S?, 64.3. 51. .his raised zhe ESAA Pilot evaluation budget from 
37, zo 67, nf zhe program budget. "These levels were insisted 'upon by 
ESAA funding sources. Although zhis level of founding is hardly adequate 
for carrying out an evaluation^ ORE had no option in this matter. This 
vas obviated by zhe ESAA requirement for assessing zhe attainment of 
program ob.jectives. The Office of Research and Evaluation, therefore, 
has been forced zo jonduct 'in evaluation far below our usual standards. 



Surmary 3t ivaluacion Findings 
Sescriocion o c che Proq;ram 

The ESAA Piloc 'rojact 1977-73 is a raacarch projecc in che Auscin Inda- 
?end«nc School, jiscrict funded by cha Eoergency School Aid Aci: (ESAA). 
ESAA Piloc is 43a«nciaily compensacory In nature. It: ia designed "to 
overcome :he adverse aducational and social affects oc minority group 
UolAcion by Improving che acadeiHic achievement ot minority children, 
ind by offering ser/ices co students and teachers which will promote 
social growth and effective communication skills." 

ESAA Piloc Programs have been funded in AISD since 1972. Formerly chey 
had che tide Project 'assise. Although che current ESAA Pilot- is 
projeccad Co extend chrough chree academic years, each year a new 
proposal dind aoolicacion must be submiccad. 
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r^e I377-L9 73 ESAA ?i^.ac had tvo aeparace componenca . The firsc com- 
ponenc vas s vTi::ing liiscruccion program designed co improve che vricing 
5kil-;.ii And raading achievement of eiemencar/ ;rade iscudencs. The second 
•lomponenr. , Prrjj^ct Oucreach, is i guidance and counseling prograri ac cwo 
eitiraencary achooii md one junior high ichool. The wriciag inscruccion 
■':o?nponenn ucilizad a 3emi -experimencal research design uo evaiuaca che 
•ii'ractivcness oc cvo different: aiechods of -dicing inscruccion vich 
rainorlcy cUiidr«2n. The cvo aechods of wricing inscruccion shared a 
.:otranon ioax of improving scudencs' vricing skills (niechanics of wrirJ.ng 
as vei.\ a:,-! -rlccan exprassion) and cheraby improving :5cudenc3' overai read- 
ing acni^.VKme.nc . Tine ':vo ijechods of vricing inscruccion co be >5vaiuacad 
vere: 
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Language Arrs-Wglclng ; This ipproach consiaced of an iaplemtncadon of ch« 
AISD S33enciai Comp«cenci*3 in Wricing ac each grade Level. Teachers in chis 
creacaenc group received assistance cymg the Essencial Compecencies co 
specific inacruccional aiaceriai (specific lessons in che discricc-adopced 
languafje Arts caxcbook as well as ocher supplemencar/ materials purchased 
by Che ESAA Pilot Project). Teachers in chis group also received inserrlce 
training in methods of sentence building and language patterning. This 
approach vas impleoented by che participating classroom teachers during chair 
regularly scheduled Language Arts periods. This approach was conducted 'in on* 
classroom per grade level (Kindergarten through fifth grade) at che following 
schools: Oak Springs, Rosewood, Pecan Springs, and Sims. 

Social Scudles-Wrtting : This approach consisted of an adaptation of che 
Language Experience Approach co ceaching reading. Teachers in chis group 
received inserrice craining in che cechniques of che Language Experience 
Approach, teachers In chia group also received inser/tce craining in methods 
of senrance building and language patterning. These cechniques and supple- 
mentary materials purchased by che SSAA Pilot Project were co be used in che 
implemencacion of wrlcing instruction. This approach was conducted in one 
classroom per grade level (Kindergarten chough fifth grade) at che following 
ichooia: Cimpbell, NormAn, and Vinn. 

The cvo methods of •-rrlclng instruction have been implemented by regular 
classroom ceachers who have participated in SSAA Pilot Staff Development 
iessions throughout che year. The essence of che. program chen ia in che 
axtant co which che classroom ceachers have received craining in and have 
actually Lmplamentad che techniques of each method of wrlcing instruction. 

A aacond component of che ESAA Pilot Is Project Outreach, a craining program 
for -he 'Jniversicy of Taxa.. at Austin School of Social Work. The bulk of 
Project Outreach funds come from a National ''.nsticute of Mental 'Jealth 
'MI^IH) craining grant. iSAA Pilot provides- supplementary funding to cover 
supplies md other incidental costa. Although Project Outreach has been 
operating ia che schools since 1971, it did not become oart of ESAA Pilot 
iProject Assiat) until che 1973-76" schopl year. During che currant 
funding year, Project Outreach provided guidance and counseling serirlces Co 
students ia two elementary schools : Campbell and Rosewood^ and one junior 
high school: Martin. There were eleven first-year social work interns 
working in che aiJbve schools-. The interns were super/lsed by an instnactor at 
The 'Jniversicy of. Texas School of Social Work. 

The ivaluacion fiadiugs will be snmmavized according Co che decision question 
for whii.h -hey are relevant. 

Decijijg Question : 

rnould ?ro.1-2CC Outrar ^ ch '5a fatunded fjr m ^ddiclonal vqar ? 

The one objective lijcad fjr -:he 197" ~7S Project Oucraach vas compiacaly 
ictaiaed. T?ie ob jeccive .^inec .iied chat it Idasc 33% 3C :he students who hava 
racaived iirgct ser-zlces bv ?ro-''3cc Outreach vill have, unproved In che areas 
for which :hev were ref »rrad . Tne Project Oucraach iocial Vork interns worked 
direcr -Jlch aora chau il2 jradeutS' ir, Campbell ind Aosewood Elementary 
•3chcol3 ...d Maria Junior Hign 3chool. TAc. nacur^i :heir vork -Hth chesd 



3CU(i«nc3 ranged from individual and group counatling co ch« •acablishronc 
oc a school wld« system of reinforcing poaicive scudenc behaviors. 
O erall, 40. i: of the students being served by Proj it Outreach had 
improved in the area for which they were referred. The improvement in 
student behavior vaa especially evident at Rosewood. Teachers at Rosewood 
on Che average rated students who were participating in Project Outreach 
as having improved in all fourteen categories of academic and social 
behavior being assessed. 

Should S SAA Pilot be refunded for an additional year ? 

Two objectives were listed for the 1977-78 Pilot Project writing instruction 
component. 3oth of the objectives were partially met. The first objective 
specified that 50:! of a s ample of the students in the pilot classrooms, grades 
2-5, '.rill demonstrate a sig nificant increase in reading achievement relative 
CO a 3amoLe of stud ents nQc__oarticipating in the ollot orolec? ! More than 
oOO elementary students participated in the 1977-73 ESAA Pilot Project writing 
instraction component. These students received '-writing instruction from their 
regular classroom teacher in either Language Arts or Social Studies class 
periods. la order co assess one aspect of the writing comoonent, a comparison 
was Mda between Spring 1977 and Spring 1978 California Achievement Test- 
Reading scores. More chaa 5QZ af the students in all Pilot classrooms, grades 
2-5 demonstrated some improvement in reading achievement as measured bv the CAT. 
This increase, however, was not statistically significant .relative co a control 
group which had not participated in c.he pilot oroject. The objective was 
Cher afore only partially attained. 

Further axaminacion of the CAT data indicated chat students in each of the 
:wo '-o-lcing instruction approaches improved cheis reading slcills from Spring 
1977 CO Spring 1973. The overall improvement for each group was at a level" of 
acatiatical significance. In both groups, the greatest, amount of improvement 
was found cor third and fourth grade students, aach showing- a gain of almost 
one grade equivalent. 

A further comparison was made between the CAT-Reading scores of students in 
each of che rvo different writing instruction approaches. Results of 
:.hij companion indicated chat while there appeared co be sizeable differences 
betveen che r^o groups on cheir average gain on che CAT, t.ha differences 
were not large enough co reach a Level of statistical significance. There- 
fore, it appears that the two approaches co 'Siting instruction had an equal 
effect upon students' improvtement of reading skills. 

•pie second objective specified t.hat che 'tricing skill comoetencias of at 
least 6CZ of a 3a mT?le of che students in che oilot project classrooms will 
have impr oved significantly . During che first week of November 1977 and che 
middle of li^y 1973, all of che students in che Pilot Project classrooms 
participated ir. -vricing experiences. The purpose of ches*- cvo experiences 
was CO ^generate samples of students' -dicing which could be used Co assess 
:ha eff acciveneiis of che wrlning instruction programs. 

Thirteen different aspects of student •vriting were identi.-ied ror che 
purpose of assessing improvements in -.siting skills. Theso, vu'-'rfmt 
aspeccs of 'vrifng included neasures of -.JTicing productivir/ , ^la^iuricv, 
:ompiexiC7, and gT.ammar . The '-rrlcing iamples coliecceo in ^ovemb'i»r and May 
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v^rft avaluattd by a panel of three raters who were trained in the use of 
a writing assessment instrument. 

A comparison was made between each student *3 wrltliig sample from November with 
that written in May, Results of this comparison indicated that more than 602 
of the students improved on S of the 13 aspects of writing being assessed « 
In general, the objective was met or partially met for the aspects of writing 
which reflected specific characteristics of tha essays such as the number of 
words in the essay. Less improvement was found in general measures such as 
paragraph usage, type of sentence usage and overall quality. Although the 
program's stated objective, which was la terms of percent of students caking 
gain, was met for only five variables, the mean scores for both the Language 
Arts g^roup and the Social Studies group showed statistically significant im*' 
provement for almost all the 13 aspects of writing. Thus, the objective's 
criterion of 60Z may be unrealistic, as is often the ca e with new programs 
without longitudinal data. 

Further comparisons were made between students' scores in the Language Arts-' 
Writing group and those in the Social Studies-Writing group to determine If 
the two approaches produced similar results. The resviLts indicate that 
neither of the two groupa showed consistently better gains than the other. 
It appears then that the two approaches to writing instruction had an equal 
effect upon students' Improvement of writing skills. 

While both groups did demonstrate significant gains, these gains were not 
significantly greater than the gains found ina group of students which had 
not participated in the writing instruction program. The nature of tha 
control group, however, makes interpretation of experimental versus control 
group differences tenuoua. In particular, the small size and non-random nature 
of the control group a^d tha potential for commiirlcacion between control group 
and experimental group teachers are serious limltatluns which must be 
considered when looking at the data. Therefore, with all of these considerations 
in mind it cannot necessarily be concluded that the gains found ware due to 
the Pilot program. 

Typically, it takes two to three years for a aew program to become well 
implemented and begin to affect outcome measures. During the first year of 
.1 new program, therefore, reliance on outcome measures alone can be misleading. 
Therefore, a teacher questionnaire was administered to determine the 
extent to which the Pilot program was actually implemented and the extent 
to which teachers involved in the project actually differed in classroom 
practices from control group teachers. 

The cvo major areas addressed by the questionnaire are taachers' approaches 
to writing and the degree of program implementation. For the purpose of 
this questionnaire writing instruction was defined as having • the following 
three ptiases. 

A. Pre'-writing phase, in which the teacher provides the students 
with experiences to serrre as subject matter for the writing; 
establishes the purpose of the subject matter; encournges the 
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3tudgnc3 CO vrica. The primary objecciva oc chis phaa* is co 

provide the student vith something to write about. 
3, Writing phase, in which the students write their first draft, 

proofread it, and confer with the teacher on their choice of 

'larding, structure, and sc corth* 
C. Inatruction phase, in which the teacher may: group students for 

specific instruction (e.g., phonic analysis or writing mechanics); 

guide the writing process; encourage and assise the students in 

their writing. ■ 

More than 30Z of the teachers in the Language Arts Writing, Social Studies 
Writing, and Control groups agreed that this definition of writing instruction 
paralielj their own. More than 60i of che teachers in each of the groups 
reported that they actually follow€d the three phase method of instruction 
either to a great or to a oioderate degree* All groups charactrsrlzed their 
primary approach to '-siting instruction as one tliat places the highest 
emphasis on antouraglng students to write as much as possible without ''peclilc 
concern for accxiracy in writing aechanics or gr^immar. 

In response to questions regarding their actual irplementation of 
che writing Instruction program, more than 30% of the teachers in 
:he Language Arts Writing group and in the Social Studies Writing group 
reported chat writing Ijistraction occured in Language Arts as well as 
Social Studies content areas* In both groups, the majority of teachers 
(more than 60^' indicated that they spend beween LO and 40 minutes a day 
ia writing instraction. In both groups, at least 69Z of the taachers 
indicated that chey iapleoented che program either adeqxiataly or complataly, 

The ipproach to writing instruction described by teachers in a.U chrae groups 
l3 highly similar. Such a finding suggests that the nature of the writing 
instruction curriculum alght then be considered as a possible applanation 
for the lack of significant differences foiand beween the gain In writing 
skills evidenced by students In th« chrea groups. Again, due to the 
Inadequate nature of the Control group, such a hypothesis muse be considered 
only tentative and warrants further investigation, 

la response to questions regarding the implementation of the actual techniques 
of each writing program "'IZ of the teachers in the Social Studies Writing 
group indicated that they applied the Language-'Sxperience approach either to 
a moderate degree or to a great degree, Hrvever, in response to a question 
regarding teachers' use of one of the major techniques in the Language- 
Hlxperienca ipproach (taking dictation) only 557;; of the taachers in the 
Social Studies group indicated that :hey had used this cachnique moderacal/ 
or ^ixtenslvely '^th their entire class, Slaven percent indicated chat they 
had aot 'osed che techniques at all. In contrast co che Social Studies group 
571 of che taachers in che Language Arts group indicatiad chat they had used 
chis cachnlque noderatpi/ or ^xtansively vich cheir entire class. Onl/ 5;^ 
indicated chat chey had not used che techniques at all, ThiJ is in spica of 
che fact chat only che Social Studies group received craiAia? in chij 
cachnlque from che ISAA Pilot Staff Development. Further ::ompari3ons indicated 
chac 50!; oi che teachers In both groups utilised che Laidlow Language .lrt3 
ce:xtbook3 •aicher co x aioderata degree or a gr^t degree* 
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ABSTRACT 

Title: Pilot - 1977-78 Final Technical Report 
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No. Pa^e.a ; 115 



Summary ; 

n\is is the accompanying document to the ESAA Pilot Final Evaluation 
Report. 

Each appendix contains: 

An instrument description 
Purpose of the measure 
Procedures used to collect the data 
Summary of results 

Tables and figures presenting the data, 

Tlvls technical report contains the follov/ing appendices: 

Appendix A: California Achievement Test 
Appendix B: Assessment of Writing Skills 
Appendix C: ESAA Pilot Teacher Questionnaire 

Appendix D: Teacher's Evaluation of Pupil Behavior 

[ntormation in these appendices is summarized in the Final Report for 
this project. 
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ABSTRACT 



Title: ESAA Pilot Evaluar.ion Design (1977-78) 



Contact Person: Myron Friedman 



No, Pages : 13 



Content : 

The evaluation design is a one-year plan of evaluation work for the 
project. The table of contents for this document includes: 



I. Evaluation Design Review Form 



This chapter presents the names and/or 
signatures of persons (responsible 
for some aspect of the project's 
implementation) who have been provided 
relevant portions of the design for 
review and comment. 



II. Decision Questions 

A. Questions Addressed 

B, Ovenriew 



Here the evaluator states all the decision 
questions and relates them to the evaluation 
questions and objectives (and their data 
sources) • 



III. Narrative Suimi^ary 

A. Program S^'oanary 

B. Evaluation Summary 



This chapter briefly describes the project 
and the evaluation activities tied to the 
project. 



IV, Information Sources Summary 



The principal evaluator(8) provide work 
estimates (in per8on*-days) for each person 
on the evaluation team. Work estimates 
are projected for each ''information 
source" and are broken into the four 
typet of evaluation tasks: development , 
collection^ analysis^ and dissemination. 



V. Summary of Data to be 
Collected in the Schools 



This is a timeline for the collection of 
data in the schools. 



VI. Evaluation Time Resources 
Allocation Summary 



This chapter su!jmarizes all the evaluation 
work estimates (in person-days) by 
positloni for each aspect of the eval^ 
uation. 
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Evaluation Design Summary ; 

The focus of the evaluation of the ESAA Pilot for 1977-1978 will be 
on a research design to determine the effectiveness of the two treat- 
ment models in improving writing skills directly and reading achieve- 
ment indirectly. Information will be gathered from district-wide 
achievement data as well as from a pre«p08t«as3essment designed 
specifically to tap the writing skills which are the basis of the 
proj ect. 

Another area of investigation will be the effectiveness of Project 
Outreach in helping referred students improve in social-behavioral 
areas. Information will be gathered from teachers' responses on a 
pre-post rating scale of pupil behavior. 



Scope of Design ; 

8 Decision questions (Level: Office of Education, Program) 

9 Evaluation questions 

Evaluation Resources Required (in person-days) : 

1 Coordinator 
6 Senior Evaluator 
65 Evaluator 
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i':va luat io n Find Lags o n: Education for Parenthood Program 



Conta ct f ^erson; Nancy Baenen, Paula Matuszek 



S umma r y of E valuation Findings : 
Descr iption of the Program 

The Education for Parenthood Pilot Project (EPP) is a cooperative program 
of the Austin Independent School District (AISD) and Child Incorporated, 
a non-profit organization which runs a number of local day care centers. 
The development of the Education for Parenthood Project stemmed from a 
growing concern for the increased number and attrition of student-parents, 
and the lack of adequate services to meet their needs. The Education for 
Parenthood Project (EPP) is designed to meet the needs of several target 
groups: I) all high school students who are interested in becoming 
better prepared for the responsibilities of parenthood, 2) students who 
are Interested in preparing for work in the child care area, 3) student- 
parents, and 4) the children of student-parents. EPP attempts to provide 
education for parenthood courses for secondary students (who are present 
or future parents), pre-employment training in child services, and infant 
and family teaching centers for the care of the Infants and toddlers of 
student-parents (plus a few children from the community). 

In larder to meet these goals, homemaking course offerings at Johnston, 
Lanier, LB J, and Kealing were expanded or redirected to place a major 
emphasis on education for parenthood, child development, and career 
education training in child care. Four infant and family teaching centers 
were also established on these campuses, which serve several purposes. 
They provide day care for the children of student-parents, thereby 
enabling parents to mor'^ easily complete their high school education; 
ti.ey provide an opportunity for career education students to work directly 
with young children under supervision; and they provide a place for 
students in ^^eneral education for parenthood courses to observe infants 
and toddlers* 

Students In all (^f the homemaking courses at project campuses are encouraged 
to visit the infant centers and use them In ways which are appropriate, 
rhe chart on the following page hows the courses which were tested as 
part K)\ the project evaluation this year, and how they used the centers. 
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Fru'ua of Coiirftr And niirntlon Uaa of Infant Canttra 





•• • • 

Pro-r«p!iiywnt lrtb<ir«t ry 


Sffqiiential patttma of rhlld 
HtvalopMnt, orlantatlon to lnh 
•xpurl^nca, obatrvatlon akllla, 
nnfvii and tkyi|li^n^» Ruldantra 
rheorlpa* Year long roura^. 


Stiidenta apent about four houra In 
rlaaa par weak, and alx houm obac*r- 
vlng and working In tha canters. 




r Ivf H<iiHHtlnn (MKCF) 


On the job training for atud«ntfi 
In ncnipat lona requiring know- 
)<>dgft and akllla In onn or more 
h*'>Ri9 #conoiilca aubjcct araasf 
Courar tlm* ap»nt aalnly on gen** 
^ral cnployMne akllla with 
anne Ind 1 v Idua 1 1 fed Ina true t Ion t 
Child Cart la qnt aattlng aoM 
atudtnta chooaa* FRLf. ia a pra- 
requlalta. Yaaylong courae. 


Srudaiita work M to 20 houra per 
week In Infant centers* Receive 
clsaa Instruction 5 houra a week. 

'V 




rhIlH ri^vflopm«»nr A 


Freparatlon for paranthood, child 
care, pre- and poat-natal rare, 
child Hevelupiaene atagea up to 
2 years, guidance, comanmlty 
health aervtcea, lob opportunltlea. 
One quarter. 


Occasional iiae. Aanunt of uae tenda to 
vary with teacher. Ohaerve Infanta 
and toddlera* 


for PHrt-nthcHMl 


f'hllH tVv^lopm^nt B 


Baatc needa and developMntfll 
patterns ofv. the young child from 
age 2 to 6* For future parents, 
child care peraonnal, aoclal 
worker a, teachcta, etc. One 
quarter* 


by teacher. Obaerve Infanta and 
toddlera. 




FamtLy LI v lng/i:h I Id 
D^wrlnpment I C 


Appreciation of aalf and othara; 
faally relatlonalpa; adolaacant 
(levelopment; getting along with 
othara* Adoleai-ent developatent; 
care and guidance of children; 
children In family; job oppor- 
tunltlee related to child devel- 
opmeiU. One quarter. 


'^ccaslonsl uae at teacher*a dlacretlon. 
Generally laaa often than fhlld Devel- 
■lent claaaea* Ohaerve Infanta and 

toddlers. 



Thus, students in career education courses (HECE and PELE) work in the 
Infant and family teaching centers on campus on a regular basis. Stu- 
dents In the courses designed for the general high school population 
visit the center primarily to observe, and generally do not come as often. 

The high schools that have infant centers will be call "project schools" 
throughout this report; those which do not will be referred to as "non- 
project schools". The main difference is not in the courses offered, 
since all high schools do offer parenthood education courses. The pri- 
mary difference is the presence of the center on campus and their use in 
connection with the courses. Students at non-project schools in career 
education courses do work with young children, but do so in community 
day care centers and nurseries. Students in non-project schools in 
courses for the general high school populations, however, do not have a 
regular opportunity to obaerve. Student-parents who attend these schools 
must make their own day care arrangements. 
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A final dlBtinction which should be made is that the Teenage Parent 
Program and the Education for Parenthood Project art not synonymous. 
The Teenage Parent Program primarily serves the needs of students while 
they art* pregnant. Students attend the Kealing Learning Center until 
they have their child, but then usually must leave by the end of the 
following quarter. When the Education for Parenthood Program began 
In 1976-77, it took over the operation of the Kealing infant center. 
The Education for Parenthood Project primarily deals with student- 
parents after their children are born, and in a somewhat different 
manner* Student-parents are provided with free day care to enable 
them to more easily stay ir school. In addition, parent clubs meet 
at the centers to discuss tne special concerns of parents. However, 
EP? also serves students interested in careers in child care, as well 
as all students interested in becorjlng better prepared for parenthood 
in general. The centers serve as tekching sites for these students. 
About 7% of the total number of students served by EPP during 1977-78 
were student-parents. Thus, the focus of the programs and the popula- 
tion served are somewhat different. 

Evaluation Findings 

The effectiveness of the Education ^fbr Parenthood Project is rather 
difficult to measure objectively. However, evaluation data can provide 
some Indication of the value and success of the program in meeting its 
objectives and goals. The evaluation findings will be summarized 
according to the decision question or questions for which they are 
relevant . 

Decision (Questions ; 

Federal/state level ; Should funding of the Education for Parenthood 
Project be continued? 

System level ; If outside funding is not available, should AISD fund the 
V) reject? 

• 

All five of the process objectives for the project were met: a plan for 
the revision and refinement of the project was developed, revised, 
finalized^ and implemented by January, 1978 and the evaluation component 
was fully implemented by May, 1978* 

Thv outcome objectives which relate to these decision questions stated 
chat; 1) Students 'mrolled in Education for Parenthood courses will 
score significantly higher on an achievement test of knowledge of child 
development and family living principles at the end of the couraes than 
nt the beginning; 2) Students enrolled in EPP courses who regularly 
visited an infant center will score significantly higher on an achieve- 
ment tost given at the end of the courses than students who did not; 
0 Students' <ttitudes towards parenthood and child rearing will be 
different ^e end of Education for Parenthood courses than they were 

at the beginning; 4) lY/u of career education students enrolled during 
1*^76-77 will able to find empio>Tnent after completing the program 
(1 >ng~term iihjectlve); and 3) 7bZ of enrolled parents will continue in 
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school after giving birth. 

Three of these objectives were met; two were not. 

An Education for Parenthood Achievement Test was developed by ORE and 
project staff by January, 1978, and students were tested at the end of 
the second quarter, and the beginning and end of the third quarter. 
Average student scores were not significantly different on the pre- 
and post-tests. Thus, the first obJec1;ive was not met. The reason for 
this is not clear. It may be that the test is too difficult or that the 
material covered in the courses did not match that covered in the test 
(although teachers helped to develop the questions based on course 
content) . 

However, the second objective was met. Students in PELE and HECE 
courses, who visit centers more regularly and work more directly with 
young children, did show higher scores on the post-test than other 
EPP students. Also, students who visit an infant center more than 
ten class periods per quarter do better on the EPP test than students 
who go less often. 

The post-test scores of all students in EPP classes at project schools 
and all students in parenthood education courses at non-project schools 
were compared to a control group at the end of the second and third 
quarter. Both groups of parenthood education students scored higher 
on the test than the control Ftudents (who were HECE students working 
in non-child care employment settings) . The second quarter results 
showed project students to have higher, but not significantly higher, 
EPP test scores than non-project students. The results for the third 
quarter showed the non-project students to have significantly higher 
post-test scores than the project students. When pre-test scores were 
taken into account, however, the two groups' post-test scores were 
not significantly different. These results suggest that student o who 
attend project schools, when considered as a total group, do not tend 
to score higher on a test of child development knowledge than students 
In non-project schools ♦ 

Fart of the reason for these results may be explained by the STEP 
scores of EPP students. A comparison was made o\ the Reading and Writing 
subtest scores of students in project and non-project schools who took 
the EPP test. It w,?s found that project studencs score lower than non- 
projert students a'c all grade levels on the two subtests (except twelfth 
grade reading, where the two groups achieved similar scores). It is 
possible that differences in student STEP achievement may be related to 
scores on the EPP achievement test; an effort will be made to determine 
this during next year's evaluation. For example, there may be a relation 
ship between EPP achievement scores and reading achievement on the STEP. 
In addition, students who achieve higher scores on the STEP and EPP tests 
may have better tent-taking skills than those who do not. Thus, lower 
tt»Kt scores may not necessarily reflect less knowledge of the subject 
area. 
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Tlu' fuurtli objectlvf dealL with the ability of career education students 
to rind employmunt in the child care field. This is a long-term objec- 
tlvi', and the Information provided this year through a survey of teachers 
aid not provide conclusive results. About one-half of the students 
are St II) In school. The teachers did not know the employment status of 
64-76'/', of those who have now either graduated or dropped out. Teachers 
did report that 24% of the students who attended project schools, and 
i61 of those who attended non-project schools are currently working in 
the child care field, or studying child care or a related field in 
college. Information about the number of students who seek and find 
employment In the child care field will be sought again during 1978-79. 

The fifth objective deals with the numb.er of student-parents who remain 
In school after giving birth. The combined drop-out rate for the 
Johnston, Lanier, and LPJ infant and family teaching centers during 
1977-78 was 19% (12 of G4 students). The percentage of EPP student- 
parents who dropped out while attending Keallng during- 1977-78 was 11%. 
These figures compare favorably to those from 1976-77, when 28% of the 
EPP student-parents at Johnston, Lanier, and LBJ, and 11% of those 
at Keallng, dropped out. About half of the student-parents in EPP 
during 1977-78 at Johnston, Lanier, and LBJ are still in school; 19% 
have now graduated. Thus, more than the criterion level of 75% of t i 
students remained in school after giving birth, and the objective was 
met. 

Progress has been made toward achieving t;he program goals for which 
evaluation data is available. EPP courses are providing information to 
students which should help them to become, or be, more responsible 
parents; some EPP students have been able to find gainful employment 
In the child care field after completing the program, 'and most EPP 
students-parents are remaining in high school and graduating. An important 
reason for this may be the availability of quality day care for their 

children. 

(J 

The T(>xas Education Agency (TEA) provide' $133,719 for the operation 
of the Education for Parenthood Project this year. Based on the number 
t)f studients who visited the infant center at least once (1A33), the cost 
per student for 1977-78 was $93.31. This included $77.37 per student 
for pilot expenses, $11.86 per student for evaluation expenses, and 
$4.08 per student for ongoing expenses. All of the pilot expenses will 
no longer be necessary once the program is firmly established, or will 
be covered by outside funds if AISD decides to continue the project 
after 1978-79. AISD would make the decision regarding the continuation 
of evaluation funding. AISD would need to cover the ongoing expenses 
of $4,08 per student, 

Syst or.1 level : If funding for the entire project is not available, should 
some romponents be recommended for funding? 

The niajoi omponents of the program include classroom Instruction, the 
Infant renters, d issemlnal: Ion, evaluation, community involvement and 
r(n)rdlnat ion and resource management. The evaluation can provide 
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(ntormatlon relevant to tht^ effectiveness of clasaroom instruction and 
the infant centers. The effectiveness of classroom Instruction can be 
further divided into the effectiveness of the program for the general 
lilgli school population, career education students, and student-parents. 

A great deal of the information presented in the discussion of the 
advisability of funding ihe overall project is relevant to this, and will 
only be briefly summarized here. However, some additional information 
also relevant. 

Students did show variations In EPP test scores which were related to 
the courses taken. Based on May post-test scores, career education 
students achieved the highest scores (PELE followed by HECE) ; followed 
by Child Development students, parents, and finally Family Living/Child 
Development students. Family Living/Child Development students are 
generally 9th or 10th graders > and have the least contact with the cen- 
ters. The fact that parents do not score higher may be related to 
the fact that they achieve very low scores on the STEP. Their median 
reading scores, for example, are below the tenth percentile at every 
grade level except grade ten. This is considerably below the perfor- 
mance of project students, non-project students, and the AISD median. 

A comparison of scores of project and non-project students reveals that 
non-project students in Child Development, Family Living/Child Develop- 
ment, and HECE (Child Care) achieve higher scores on the EPP test than 
project students. The only project students who achieved higher scores 
were PELE students. Again, it is possible that these results may be 
affected by the generally lower achievement shovm by project students 
on the STEP. It seems clear, however, that the students who are bene- 
fiting the most, in terms of EPP test scores, from the Infant centers 
at Lanier, LBJ, and Johnston are the PELE students. 

Student-parents' graduation and drop-out rates have already been dis- 
cussed; about 81% have remained in school after giving birth. The 
attendance rate for these stu'de.its before and after entering the EPP 
program were also studied. Although the small number of students for 
whom complete attendance records were available must be considered, 
the data show that the attendance of student-parents improved slightly 
after they began participating in the EPP program. 

Thref* of the 56 students (5.4%) who had infants during 1976-77 and 
participated In EPP at Johnston, Lanier, or LBJ had another child 
during 1977-78. Five of the 55 (9%) of the students who attended 
Keallng during 1976-77 had children again during 1977-78. The 
Travis County birth rate for women 18 and under as of 1975 was approxi- 
mately 4.9%*. Thus, the rate of student-parents who have second child- 
ren is slightly higher than the birth rate for the county for women 
of comparable ages. Thus, the objective of a birth rate which was 10% 
lowi^r than that for Travis County was not met. 

*Based on 1975 City Health Department records of the number of birth to 
women 18 and under, and the April, 1976 census figures for Travis County. 
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A comparison of the scores of student-parents and the rest of the 
students who took the May post-test reveal no significant differences 
In the scores of the two groups, if there actually is a relationship 
between STEP scores and EPP test scores, this may be a positive 
finding, since parents* STEP scores are so low. 

For students in general EPP courses, the Education for Parenthood test 
did not reveal higher scores for those who had the opportunity to 
observe in the infant centers. This may rriflect on the type or amount 
of contact students have with children in th.- center, or may reflect 
a relationship between general academic acb ^vrment and EPP achieve- 
ment test scores. 



Career eduction students show the highest level of achievement on the 
EPP test. Approximately 31% of those who are out of school found 
work, in the child care field. 

The infant centers did seem to affect the achievement level of students 
who visit on a regular basis. Student-parents received obvious benefits 
in the form of quality day care for their children, and their attendance 
also seemed to improve slightly after entering the program. The only 
group for whom the centers have not yet proved to be beneficial (in 
terms of EPP test scores at least), are the students in general EPP 
courses such as Child Development and Family Living/Child Development. 

System level : Should centers be started on other campuses? 



A survey was conducted of students in one health class per high school 
concerning knowledge of, and attitudes towards, child care and parent- 
hood. The sample was designed to represent the general high school 
population. An average of 5A% of the students on campuses that do not 
have an infant center answered each question correctly. Over three- 
fourths of the students knew the answers to a few questions, but less 
than one-third knew others. Thus, students seem to have some correct 
ideas about child care and parenthood, but definitely do not know 
everything;. 

The percent of students on project campuses that answered the survey 
questions correctly was similar to that of students on non-project 
campuses. Students in both groups felt there was a need for courses 
In child development, and about one-half of them indicated that they 
would probably or definitely take such a course. More students said 
they would stay in school if they had a baby right now if free day 
care was available than if it was not. Thus, students perceive a 
need for the services provided by EPP both on project and non-project 
campuses. One interesting difference in the responses of students at 
project and non-project schools was that students at project schools 
Indicated that they had more confidence in their ability to be a good 
parent to a child under one year of age than did non-project students. 

The Infants ot student-parents cared for in the Infant centers are 
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show In).', averai'.e rates of development. Babies who were cared for at 
the Lanlor anu Johnston infant centers during 1976-77 showed an 
average* level of psychomotor and intellectual development on the 
Uayley Scales of Infant Development for their age. The infants also 
showed a similar level of psychomotor and intellectual development to 
Infants from comparable backgrounds who had been cared for primarily 
in the home. 

Laboratory experiences do seem to improve the education students receive 
If they are used regularly (over ten class periods per quarter). Stu- 
dents who visit the infant centers the most (generally career education 
students), show the highest scores on the Education for Parenthood 
Achievement Test. 

There are some indication that student-parents arc? staying in school 
due to the pro/lsion of infant care facilities. About 85% of the 
student-parents are remaining in school after giving birth. The current 
estimate of the percent of students in the Teenage P- Jents Pro3ram who 
remained in school after giving birth in 1975-76 is A0%. However, the 
accuracy of this figure has yet to be determined • Most of the student- 
parents are still in school, so it is impossible to say whether they 
will complete their high school educations for sure at this point. 

All of this data tends to support the view that infant and family 
teaching centers are valuable, and might be a useful addition at other 
high school campuses. 

The only data which do not seem to support this assertion are incon- 
clusive at this point. Teachers reported that only 31% of the 1976-77 
pre-employment students who are now out of school are working in the 
child care field or studying it in college. This did not meet the 
objective of 75%. However, the data are inconclusive, since teachers 
(lid not know the present employment status of over 60% of their former 
students. About half of the students are still in high school as well, 
so this data will have to be checked again next year. 

Pribram level: l3o some project components need modification? 

The EPP test findings suggest that the laboratory experiences in the 
infant centers hcwe been the most effective with pre-employment (PELE) 
students. Project students in the other courses (Child Development, 
HKCE, and Family Living/Child Development) do not show a higher level 

achievement on the test than non-^project students. This may be due 
to factors such as lower academic achievement of project students. 
However, it may also indicate that students are not visiting the centers 
as often, or using ti e centers as effectively as they could be. 

As pri»vlously stated, it Is known that about 31% of the students who 
arv now out of school and took pre-employment courses are presently 
W'.)rktng In the child care field. The fact that the teachers did not 
kniMV the present status of a large portion of their former students 
TnM::i be considered in Interpreting this figure. However, it Is possible 
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that modifications In the classes or preparation for Job hunting coui/l 
ini-rease the percentage of students who find employment in the child 
care field. 

About 81% (. f the student-parents Involved in EPP during 1977-78 stayed 
in school after giving birth. Although these figures meet the objec- 
tive, it is always possible to attempt to improve them. Also, efforts 
to locate and inform more pregnant high school students about the 
services available to them through EPP might help to reduce the over;Jl 
number of students who drop out of school due ^o parenthood. 

The process objectives for 1977-78 were all met. Three of the six 
outcome objectives were met. Thus, progress has been made toward 
achieving project goals, hut the program can still be improved. 
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Publication No, 77.50 

(Technical Report) 



\ 



A BSTRACT 

Title: Education for Parenthood Project - 1977-78 Final Technical 
Report 



Contact Person: Nancy Baenen 



No, Pages : 200 



Summary : 

This is the ^company ing document to the Education for Parenthood 
Project Final Evaluation Report. 



* ^ Each appendix contains: 

An instrument description 
Purpose of the measure 
Procedures used to collect the data 
Summary of results 
. Tables and figures presenting the data. 

This technical report contains the following appendices: 



Appendix A: 
Appendix B: 
Appendiic C: 
Ij^ Ap,t)^ndlx D: 
Appendix E*. 
Appendix F: 
Appendix G: 
Appendix H: 



Student Achievement Datp 
Student Records 
Studeht EmpV^yment Data 
Infant- A:!i3ie8sment Data 
'^Oiapus Survey Data 
Project Documentation Data File 
Evaluation Report 1976-77 
STEP Data 



Information in these appendices is s 
for this project. 



M ^zitd in the Final Report 
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PuUllcaclon No. 77.19 

(Evaluaclon Design) 



ABSTRACT 

XlL4.e: Evaluation Design — Education for Parenthood Project 



Contact Person ; Mancy Baenen 



No. Pase s; 1/ 



Summary; 

The Education for Parenthc^d Project is an innovative, cooperative 
program of the Austin ladepeu-^ent School District and Child, Inc. 
The project is designed to assis.-- in the education of high school 
students about parenting through c»,-»rdinated efforts which draw upon 
the strengths of both agencies. The u<ivelopment of the Education 
for Parenthood Project stenaed from the bTOwing concern by educators 
for the increased number and attrition of student -parents , and the 
lack of adequate services to neet this need. 

The objectives of this project are that; l) nore student-parents will 
complete :;igh schocl, 2) students will be prepared for work in child 
care field, and 3) students will be better prepared to assume %he re- 
sponsibilities of parenthood. 

The major foci of this project are on providing to present and future 
parei^ts, and students seeking careers in this area, instruction and 
guided observation for learning about child development. Education 
for Pai;enthood provides parenthood education courses through the Home 
Sconom^s Department of AISD, and operates four infant and family- 
centers on public school campuses. 

Funding for the project is based on allocations from ESEA Title IV-C 
through the Texas Education Agency, AISD, and Child, Inc. In Phase I 
(19T6-T7) of operation, the project received support from these sources 
to begin implementation. Twenty-five staff were employed, and $lU2,3T9 
was budgeted. By June, 1977, all process objectives had been achieved 
but with some delay due to lateness in employing a project facilitator. 
Despite thi3 delay, all major project components were in place at year's 
end. 

During 1977-78, Phase II of operation, the project will continue im- 
plementation of activities, and will develop and implement a plan 
for revision and refinement of the project. To support this effort, 
40 staff will be employed, and $239*000 budgeted for project operation. 
Of this total, AISD provides in-kind services of lU Home Economics 
teachers and use of facilities and Child, Inc. provides 70% of the cost 
of child care facilities. 
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During Phase I of the project, an assessment was made of project 
implementation and operation by Arbec, Inc., an independent evaluator. 
The Office of Research and Evaluation of AISD agreed to provide 
evaluation services to the project during 197T-T8 at the cost of 
$1U,000. The purpose of this evaluation is to assess the project's 
progress toward achievement of outcome objectives. The information 
obtained vlll serve as an interim assessment to assist in decision- 
making by TEA, ;JSD, and Child, Inc. about the operation and in^)act 
of the project. 

This evaluation will focus on the effectiveness of the project for 
Improving parenting education of high school students, and their 
'iVeclal populations of student -parents and career education students. 
12'aluation decisions addressed herein concern the project's continued 
operation and funding. Data will be gathered from appropriate in- 
>il'/iduals and sources about the achievement of project goals and 
objectives, and the projec-tfs impact on student achievement. These 
data will be analyzed and reported to TEA, AISD and Child, Inc. b^ 
T.ii-June, 1973 in a manner that will assist them in makln? decisions 
about the project. 



(Final Report) 



FINAL REPORT 



Evaluation Flndln&s on; Project P.A.V.E. Final Report 1977-73 



Contact Person: Richard Eglsaer 



Summary o^ Evaluation Findings : 
Description of the Program 

In 1975, a group of teachers at Travis Hi.^h School in Austin, Texas, 
developed a proposal to address the concerns of special education stu- 
dents. This proposal had as its major goal the coordination and extend- 
ing of services for identified high school special education students. 
The proposal was directed at four crucial areas in the edication of 
handicapped students: P^arental involvement. Academic achievement,. 
Vocational programming, and Extra-curricular opportunities (P.A.V.E.). 
This proposal was accepted for funding by the Bureau of Education for 
the Handicapped through the Texas Education Agency from Title VI-B 
monies. i 

The first year (1975-76) P.A.V.E. employed four staff to focus on 
specific school based changes in the types of services offered special 
education students on that campus. AISD provided in-kind support 
through the Project Director who was Assistant Principal of Travis 
High School. The total project budget was $93,278. 

In 1976-77, P.A.V.E. tested a systematic decision-making process model 
for coordinating special education services, the purpose of which was 
to smooth the transition for ninth-graders from Junior high school to 
high school by providing high school resource teachers with information 
from previous teachers, and to provide for continuous sharing of 
parental and school information throughout the school year. Addition- 
ally, effort was made to Involve parents, and to study and Improve 
direct services to students through in-service to teachers, vocational 
course offerings, physical education innovation^ career orientation 
and information, and materials development and dissemination. During 
this school year, an Academic Coordinator was appointed in January, 
and the Project Coordinator position was vacant from February to the 
end of the year. The total budget was $104,000; 

The prlmarv goals for 1977-78 were to modify and continue operation of 
rhe systematic planning process; provide inservlce training for special 
education personnel and vocational counselors in administration of 
vocational assessment instruments. To support this effort, the project 
fmp loved five staff members and operated on a total budget of $95,9AA 
lor the year. 
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Kvaluation Findings ; 



The 1977-78 evaluation of Project P.A.V.E focused on two questions: 

1) Should Project P.A.V.E. activities be dissemindted to other districts? 

and 2) Should Project P.A.V.E^ be adopted by schools of AISD? In order 

to answer these two questions a series of evaluation questions were 

formulated. These questions and the relevant findings are presented 

below. 

1.1 To what extent have school sponsored activities involved spe- 
cial education students? 

High school students in the Austin Independent School District 
typically enroll in 6 classes a quarter. During the 1st quar- 
ter of 1977-78, special education students were scheduled into 
regular classes slightly more often than in the past (4.81 
compared to 3.87 and 3.68 for students in 1975-76 and 1976-77 
respectively). 

1.2 I'fhat are the attendance and drop-out statistics for special 
education students? 

During 1977-78, 9th-grade students were absent on an average 
27.8 days, lOth-grade students averaged 28.6 absences, and 
llth-grade students were absent 23.1 days. These attendance 
rates were not statistically different from the attendance 
rates in the past. The drop-out rate for 1977-78 (19.6%) was 
slightly lower than in previous years (28.6% and 28.3% for 
1975-76 and 1976-77 respectively). 



1.3 



Have objectives for the project been met? 



Seventeen of 26 objectives w&te to a large extent implemented. 
Of the remaining 9 objectives, A were partially met and 5 were 
not met. 



To what 
credits 


extent have identified 
toward graduation? 


special education 


students earned 


Grade 


Average 1977-78 
Total Yearly Credits 


Average 1977-78 
Sp.Ed. Credits 


Average 1977-78 
Regular Credits 


9 th 


13.37 


3.81 


9.55 


iOth 


12. n. 


5.55 


6.61 


Uth 


13. 3« 


6.83 


6.06 



XVT.-2 



ERIC 



1,5 



What activities can be done by school personnel without addi'- 
tional expense? 



The following activities will probably be continued by the 
special education teachers next year; 1) Jr.-^Sr. conference, 

2) planning conferences^ 3) pre-employment lab, 4) cafeteria 
work station, 5) student monitoring, and 6) in-depth review, 

1.6 What time commitment and personnel commitment are required for 

school personnel to conduct P.A,V,E, activities and how do they 
perceive its effectiveness? 

P.A.V.E. documented the time it took to complete many of the 
activities of the 1977-78 school year. The parent interview 
^ind student interview each required approximately 1/2 hour 
to administer. The Jr. -Sr. high school conference required 
approximately 15 minutes per student. The administration of 
the Wide Range Interest-Opinion Test required approximately 1 
hou/ per student. The administration of the social Pre-Voca- 
tlonal Information Battery required approximately 3 hours for 
a group of 4 students. The planning conference required 
approximately 1 hour for each student* The student monitoring 
process required approximately 5 minutes of the teacher's 
time per student. 

The staff perceived the following activities as being most 
helpful: 1) Jr. -Sr. high conference, 2) vocational testing, 

3) planning conferences, 4) pre-employment lab, 5) adaptive 
P.E., 6) cafeteria work station, 7) student monitoring, 8) in- 
depth review, 9) parental involvement and 10) materials use 
and dissemination. 

2.2 To what extent have the same or similar activities developed 
by P.A.V.E. been implemented in other schools of AISD? 

The following activities have been largely implemented in the 
other high schools: 1) Jr. -Sr. high school conference, 2) stu- 
dent interview, 3) parental involvement, and 4) student moni- 
toring. The following activities have not been Implemented 
systematically: 1) parent interview, 2) vocational testing, 
and 3) adaptive P.E. 

2.3 What systematic Planning Process activities have been most 
utilized? 

A Jr.-Sr, high school conference was held for 9 of 22 incoming 
9th->?rade students. Sixteen of 22 (72%) incoming students 
attended the student orientation session, Fourteen of 22 (63%) 
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9ch-grade students were given the Social Pre-Vocatlonal 
Information Ba':tery, 12 of 22 (54%) 9th-grader8 were given 
the Wide Range Interest-Opinion Test, and 10 of 13 (76%) 
llnh-S''-a<le students were given the McCarron-Dlals Work 
Evaluation System. Planning Conferences were held for 44 
(83%) Identified special education students. Students were 
monitored during the 1st and 2nd quarters, and In-depth 
reviews were held for 10 students during the year. 

What kinds of decisions are now made about special education 
students that were not made before Implementation of the 
Systematic Planning Process? 

The L.S.T. decisions are basically restricted to on-campus 
referrals, off-campus referrals, schedule changes, and pro- 
gram changes. Thus the Impact of the Systematic Planning 
Process can only be gauged by the frequency with which the 
L.S.T. discussed special education students and the type of 
decisions they made. During 1975-76, special education 
students were discussed by the L,S,T, 7 times. During 1977-78 
special education students were discussed 66 times. For the 
concerns referred to the L.S.T. during the 1977-78 school 
year, 20 times (30.3%) the L.S.T. was not able to resolve these 
concerns. Seven times this was because the L.S.T. did not have 
enough Information about the needs of the students. Five times 
this was because the L.S.T. did not have available program 
options which would have met the student's needs. Eight times 
the L.S.T. recommendations were not Implemented. 

To what extent are parents, students, and counselors Involved 
In decision making? 

Forty-five of 64 (70.3%) parents were Involved and participated 
in either the planning conferences or T'£P meetings during the 
1977-78 school year. Nln^> of 64 (14 1%) parents participated 
in the Parent Tutoring sessions. Only two of the special 
education students participated in the planning conferences. 
Counselors did not participate in any of the planned activities. 

What changes are there in student achievement, drop-out rate 
and attendance? 

*» 

There were no significant differences In the total yearly 
credits, special education credltQ, rugular credits, ar.d 
vocational credits earned between this year's special educa- 
tion students and last year's special education students. 
This year's llth-grade students earned significantly more 
vocational and special education credits this year than they 
did last year as lOth-graders. This year's lOth-grade 



special education students also •arned significantly more 
vocational credits this year than they did last year as 
9th-graders* The drop-out rate was slightly less this year 
than It was In previous years (19.6% for 1977-78 compared to 
28.6% and 28.3% for 1975-76 and 1976-77 respectively). 
There were no significant differences In the attendance rates 
between special education students In 1977-78 Md 1976-77, 

2.7 What Is student participation In alternative programming 
options and other P.^.V.E, actlvltle,s? 

Five students were enrolled and received credit for the Pre- 
employment Lab during each of ths three quarters. Two stu- 
dents worked In the Cafeteria Work Station during the 2nd 
and 3rd quarter of 1977-78. Twenty-six students were enrolled 
in the Adaptive P.E. class during 1977-78« 

2.8 What changes are there in teachers^ reported classroom prac- 
tices arid attitudes with identified special education students? 

Nine of 11 (81.8%) teachers surveyed indicated that there was 
Increased communication between the regular teachers and the 
special education teachers. All 11 teachers indicated that 
the presence of Project P.A.V.E. on their campus had created 
an awareness of the needs of the special education students. 
Ten of 11 teachers felt that whenever possible special educa-- 
tion students should bie involved in the regular classroorat 
These same ten teachers however, agreed that the amount of 
time required of the regular teacher to meet the needs of the 
special education students takes away from the learning of 
regular students. Seven of the 11 teachers (63.6%) felt 
that there were not sufficient resources available to regular 
teachers to help them meet the needs of special education 
students. 

2.9 What changes in services to students derived from the L.S.T.? 

For the concerns referred to the L.S.T. during the 1977-78 
school year, 13 tiroes (19.7%) no new services were recotranended. 
Fifteen times (22.77.) the L.S.T. recoimnended on-campua referrals - 
Eight times (12.1%) off-campus referrals were recommended of 
which 5 were implemented. Nine times (13 #6%) the LtS.T. 
recommended schedule changes. Eight of these 9 schedule 
changes were implemented, and A of these 8 were helpful as 
defined by the student earning credit for the new course. 
Twenty-one times (31.8%) the L.S.T, recommended a program 
change for the student. Sixteen of these 21 recommendations 
were Implemented and 11 of these changes proved to be helpful 
as defined by a student earning 5 or more credits for the new 
program . 
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2.10 What activities do L.S.T, members think they can and will carry 
on without P.A.V.E.? 



The following activities will probably continue next yea- in 
the absence of Project P.A.V.E.: 1) Vocational Testing, 2) 
Student Monitoring, 3) In-depth Reviews, 4) Teacher Meetings, 
and 5) Materials Use and Dissemination. 

2.11 Do teachers who attend in-service training report positive 
effects for their work with special education students? 

Eight of 9 teachers surveyed indicated that the in-aervice 
program was effective and that the training received in 
the workshop generalized to the classroom. 

2.12 How many parents participate in P.A.V.E. activities (confer- 
ences, meetings)? 

Forty-five of 64 (70.3%) parents participated in either a 
planning conference or an lEP meeting. Twenty of 64 (31.2%) 
parents attended planning conferences wherlas 25 of 64 (39.1%) 
parents attended the lEP meetings. Nineteen of 64 (29.7%) 
parents did riot attend either type of meeting. Nine of 64 
(14.1%) parents participated in the Parent Tutoring Sessions. 
A revised copy of the parent handbook was sent to all the 
parents of special education students. 
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ABSTRACT 

Title ; Project P.A.V.E.* Final Technical Report 1977-78 
Contact Person *. Richard Eglsaer 
No. Pages ; 75 



iunmary : 

This is the accompanying document to the Project P.A.V.E. Final Report 
1977-78 (see following abstracts in this volume). 

The technical report consists of 7 appendices. Each appendix reports 
on the information collected by a specific data collection measure. 

Each appendix contains: t 

An instrument description 
Purpose of the instrument 
" Decision and evaluation questions addressed 
Procedures used to collect: the data 
Summary of results 

Tables and figures presenting the data 

This technical report contains the following appendices: 

Appendix A: Planning Conference Data 

Appendix B: Local Support Team Analysis 

Appendix C: Student Transcript Data 

Appendix D: Student Attendance Data 

Appendix £: Staff Questionnaire 

Appendix F: Austin Independent School District Staff Survey 

Appendix G: P.A.V.E. Activities and Verification Documents 

Information in these appendices is summarized in the Final deport for 
this project. 



*P.A.V.E. stands for: Parental involvement, Academic achievement, 
Vocational programming, and Extracurricular opportunities. 
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A BSTRACT 

Title ; Project P.A.V.E. (19"/ 7-78) Evaluation Design 
Contact Person : Richard Eglsaer 
No, Pages : 12 



Content : 

The evaluation design is a one-year plan of evaluation work for the 
project. The table of contents for this document includes: 



I. 



II. 



III. 



Evaluation Design Review Form This chapter presents the names 

and/or signatures of persons (re<- 
sponsible for some aspect of the 
project *s implementation) who 
have been provided relevant por- 
tions of the design for review 
and comment. 



Decision Questions 

A. Questions Addressed 

B. Overview 



Narrative Summary 

A. Program Summary 

B, Evaluation Summary 



Here the evaluator states all the deci- 
sion questions and relates them to the 
evaluation questions and objectives 
(and their data sources). 

This chapter briefly describes the pro- 
ject and the evaluation activities tied 
to the project. 



IV. Information Sources Summary 



V. Summary of Data to be 
Collected in the Schools 

VI. Evaluation Time Resources 
Allocation Summary 



The principal evaluator (s) provide 
work estimates (in person-days) for 
each person on the evaluation team. 
Work estimates are projected for 
each ^^information source*^ and are 
broken into the four types of eval- 
uation tasks: development , collec- 
tion, analysis I and dissemination. 

This is a timeline for the collec- 
tion of data in the schools. 

This 'chapter summarizes all the 
evaluation work estimates (in per- 
son days) by po<3ltion^ for each 
aspect of t'ixe evaluation. 
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Publication No* 77*20 



Evaluation Design SmnmAry ; 

School year 1977-78 marks the end of the three-year funding cycle for 
Project P.A.V.E. In June 1978, the Texas Education Agency, mstin 
Independent School District, and other school districts in Texas will 
need information about the impact of services and activities developed 
by P.A.V.E* on special education students. 

This evaluation will focus on the effectiveness of each component of 
P.A.V.E* for improving the education and achievement of psecial edu- 
cation students • 

Data will be gathered from appropriate individuals and groups about 
the effectiveness and replicability of activities and services 
developed by P*A*V*E* Data will also be gathered about the extent to 
which P.A.V.E. activities have already been disseminated in the Austin 
Independent School District. These data will be analyzed aiid reported 
to the Texas Education Agency by mid-June 1978 in a manner that will 
assist others who desire to replicate these activities to assess their 
worth and cost. 



Scope of Design : 

2 Decision Questions (Levels: State and System) 
18 Evaluation Questions 



Evaluation Resources Required (in person-days) : 

5.0 Senior Evaluator 
52,5 Evaluator 
20.0 Evaluation Assistant 




Publication No. 77,06 
(Ad Hoc Study) 



ABSTRACT 

Title ; Allan Junior High School S,W,A»T, Team Evaluation Report 
% 

Contact Person ; Gary W, Weibly 
No> Pag es; 34 



Summary ; This report was the result of a service request made by the 
principal of Allan Junior High School to the Office of 
Research and Evaluation to conduct a "mini«evaluation*' of S.W.A.T,, 
a special program at that school, Project S.W«A.T. (S^tudents 
With it All Together) was designed to provide positive rein- 
forcement to those students exhibiting appropriate classroom 
behavior, Specfically, the program had the primary objective 
of reducing the number of discipline referrals to the school 
office. 

The scope of the evaluation of this project was restricted due 
to a severely limited time frame and resource budget. These 
limitations allowed for only three type of information gathering 
efforts; (1) collection and analysis of already existing discipline 
data, (2) assessment of student opinion through questionnaire, and 
(3) assessment of teacher opinion through questionnaire. These 
limitations, and others described in the report, limited the 
degree to which the results could be interpreted and generalized. 

The purpose of the S.W^A.T. Program evaluation was to collect 
information regarding its effectiveness. This Information was 
then used by Allan and district administrators to help make some 
key decisions about tha program. The two major decision questions 
addressed by the evaluation activities were; 

(1) Should the S.W.A.T. Program be continued (refunded) for 
the 1978-79 school year?, and 

(2) If continued, should the S,W,A,T. Program be modified in 
any way? 
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Publication No. 77.06 



Data collected through the three methods described above 
indicated that, overall, the S.W.A.T. Program has been well 
received by both teachers and parents and it has been effective 
in reducing the discipline referral rate. Suggestions for change 
were varied, but generally centered on: (a) concern over rh« 
merit /demerit system being used, (b) expressed need for more 
variety in S.W.A.T. activities with less time between events, 
and (c) a desire to cut down on the paperwork associated with 
the project. 




Publication No. 77.01 



(Ad Hoc Study) 



ABSTRACT 



. Title ; Office of Research and Evaluation Procedures Manual 
Contact Person : Freda Hjlley 
Nq> Pages : Changes PeriodtcalJ.y 

Sui nnary ; The Office of Research and Evaluation Procedures Manual was designed 
td assist employees ot that office perform their work. Each staff member has 
access to a co\. r which details procedure associated with a wide array of the 
tasks and activities carried out at ORE. 

The procedures c>{i£lined in the manual are not set in concrctet a process for 
periodic updating and revision is included in the opening pages. Procedures 
are listed for activities following into eight general categories: 

* Administration 

* Finance 

* Personnel 

* Data Collection 

* Data Management 

* Typing Guides and Formats 

* Files 

• * Miscellaneous 

Each of these sections begins with a cover page that identifys the ORE. 
resource person for that section, who the section is of primary importance to 
(e.g., all ORE staff, district funded staff, secretaries, etc.), and a list 
of contents. For an example of content, the procedures currently listed in 
the Personnel section include: 

. Personnel Recruitment . Leave Forms 



Job Descriptions 
Appointments 
Career Ladder 
leaves 



Travel and School Leave 
Lunch and Coffee Breaks 
Personnel Evaluation 



PubllcAtion No* 77*04 
(Miscellaneous Document) 



ABSTRACT 

Title : List of Junior High CAT Testing Reports 

Contact Person ; Jane Ogden 

No, Pages ; 3 (with 9 attachments) 

Summary; 

This is a list of the reports of junior high school CAT testing 
that are created by ORE. The reports are divided into three 
categoric^: reports of individual student results, schoolwlde 
summary reports, and districtwide summary reports. Each report is 
briefly described, and a sample of each report is attached. 
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Publication No. 77.05 
(Miscellaneous Document) 



ABSTRACT 

Title: List of High School STEP Testing Reports 



Contact Person : Jane Ogden 



No. Pages ; 3 (with 9 attachments) 



Summary : 



This is a list of the reports of high school STEP testing that are 
cr a tod by ORE. The reports are divided into three categories: 
reports of individual student results, schoolvlde summary reports, and 
dlstrlctvlde summary reports* Each report is briefly described, and a 
sample of each report is attached. 




Publicttion No, 77.27 
(Miscellaneous Documenc) 

ABSTRACT 

Title; Testing Guide '78 for Junior High Schools 
Contact Person ; Jane Ogden 
No, Pages : A 
Sunmary : 

This is a hand-out designed for distribution to all AISD Junior 
high school teachers, to explain the procedures to be followed during 
the California Achievement Testing in their schools , and to provide 
other pertinent testing information. The following topics are Included: 

1* How the CAT scores are used to meet high school graduation 
requirements, 

2. Teachers* responsibilities before, during, and after the 
CAT testing. 

3. Which students are exempt from testing. 

4. How to fill in the Information fields on an answer sheet, for 
students who do not have pre-*prlnted ID information, 

5. How to use a special circumstances log. 

6. What to do if a teacher sees students cheating during the 
test. 
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Publication Nc. 77.28 



(Occasional Paper) 



ABSTRACT 

Title ; Minimum Competency Requirements: What to do when your school 
board sets them 

Contact Persona; Mary Minter, James Watkins, Paula Matuszek, Ph.D. 
No. Pages ; 19 
SUnroary ; 

This is a discussion of the school district's efforts to initiate a 
minimum competency testing program. The major difficulties experienced 
in dealing with policy issues, technical problems, and routine mechani- 
cal problems of implementation are identified and the rational for the 
particular strategies selected are shared. 

Comments ; 

This paper was presented at the First Annual Meeting of the Southwest 
Educational Research Association in Austin, Texas, January, 1978. 
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Publication No. 77.29 
(OccAflional Ptptr) 



ABSTRACT 

Titla ; Programning for the Disadvantaged Student: A Case Study of an 
Input Evaluation 



Contact Person; Paula Matuszelc, Ph.D. 



No . Pages ; 15 



, Sunmary ; > 

Context and input evaluations preceedlng acttial program lioplamentation 
have long been recognized by evaluators as effective ways to provide 
information to decision malcers. This is especially true in the area of 
compensatory programs. Planning educational programs for the disadvan- 
taged student is a difficult task; evaluation can provide Information to 
Improve such planning. 

During the 1976-1977 school year the achievement of disadvantage.1 stu- 
dents was set as a priority for the Austin Independent School District, 
and as aprt of that priority the AISD Off ice of Research and Evaluation 
carried out an extensive context and input evaluation designed to faci- 
litate the ecjlucar.ional programming for such students. This study had 
three main foci. First, the achievement and other characteristics of 
AISD's low SES and minority students were examined. Variables considered 
Included achievement, attendance, mobility, self-concept, attitude toward 
school, home background variables, graduation requirements, and. a variety 
of other outcome measures. This examination served to lllts&lnate the 
situation, indicating the extent to which various areas were in fact 
problems. In some cases, such as achievement, we found that the problem 
was even greater than we had supposed. In others we were supprosed to 
discover that we did not necessarily have a problem— there were no 
substantial differences among groups in the affective measures given at 
the elementary level. 

The second focus of the study was on programs already being Implemented 
in Title I schools. (AISD has ESEA Title I, Title I Migrant, Title IVC 
and Title VII programs, ESAA Pilot and Basic programs, and a variety of 
state and local efforts operating in its disadvantaged schools.) 

The third focus involved exploring the research to get ideas of what 
kinds of programs seem to be effective in helping low SES students and 
what kinds of classroom patterns and interactions seem to facilitate 
their learning. 

This paper presents t)^ major findings of the study and discusses how 
information was fed back into the priority setting for the district, as 
well as what impact it had on program planning. 



Publication No. 77.30 
(Occasional Paper) 



ABSTRACT 



Title ; Administering the Tests of Basic Experiences to Low SES Mexican* 
American Pre-kindergarten Students: Caution. 



Contact Person: David Doss 
No. Pages ; 10 

Sungoary : 

This paper reports the results of an ^ administration In English of the Tests 
of Basic Experiences General Concept Test to 72 Mexican-American pre-klndergarten 
(4-year-old) students during the fall of their pre-kindergarten year. Examina- 
tion of the internal consistency reliability (alpha coefficient) and the propor- 
tion passing each item indicated that the test was too difficult for the students < 
The paper describes the population tested ^ the test administration procedures, 
the analyses, and the results- It is recommended that the TOBE not be given to 
four-year-olds from a low SES background unless provisions are made to check the 
reliability before using the results. 



Comments : 

This paper was presented at the 1978 Annual Meeting of the Southwest Educational 
Research Association in Austin. 



Publication Mo. 77.32 
(Occatioiial Paper) 



ABSTRACT 

Title ! Bringing Research and Practice Together on 
Teacher Evaluation 



Contact Person: Freda Holley, Ph.D. 



No. Pages ; 6 



Sumnary : 

This paper discusses the discrepancy between school district needs 
for Information on teacher evaluation and the kinds of research 
data that Is available. A description of the prac^'tlcal and research 
literature reveals few answers to the practical questions that are 
being asked. A discussion of the efforts to collaborate between 
the Austin Independent School District and the University of Texas 
Research and Development Center In order to bridge the gap between 
practice and research concludes the paper. 



Comments ; 

This paper was presented to the Annual Meeting of the Texas 
Association for Planning, Evaluation, and Research In Arlington, 
Texas on February 23, 1978. 




Publication No. 77.33 
(Occasional Paper) 



ABSTRACT 

» 

Title ; Beyond Dissemination: Helping School Board Members and 
Administrators Take Actic.n on Evaluation Findings 

Contact Person: Freda Hqlley, Ph.D. 
No, Pages ; 30 



Sumnary ; 

This author takes the stance in this paper that the evaltiator's 
responsibility does not end with the writing of a report on an 
evaluation project. Evaluation or rese'^rch findings need to 
result in Improved decisions and resultant actions if public 
school evaluation stands a chance of succeeding as a field. The 
responsibility ot seeing that this happens in a districyhaay 
well need to be shared by evaluators. The paper contiifln to 
explore the problem and provides a description of one system at 
training process that a school system evolved. The system 
includes a ''future focus'* for evaluation studies and a district 
priority setting cycle. The training includes schedule, formats, 
and a "Reconmendations Manual." The training process is initiated 
by the Superintendent. 



Comments ; 

This paper was presented at the 1978 Annual Meeting of the American 
Educational Research Association in Toronto, Canada. 




Publication No. 77.35 
(Occasional Paper) 



ABSTRACT 

Title ; Compensatory Programs Do Not Supplant, They Supplement: Right? 
Contact Person ; David Doss, Joy Hester 
No. Pages : 21 ' 
Summary : 

The regulations and guidelines issued by the Office of Education and 
state education agencies imply that local districts must provide "some- 
thing extra" with ESEA Title I funds. On many campuses other compen- 
satory programs also compete for the time of Title I eligible students. 
In an attempt to determine what the something extra is that Title I 
provides and the effects of multiple compensatory programs on providing 
the something extra, information available from a 1976-77 study of 
students served by multiple compensatory programb :.nd a study involving 
daylong observations of 225 students on a minute-by-minute basis was 
analyzed to answer the following questions: Are Title I students 
receiving something extra? If a student is served by Title I and a 
bilingual program, does the something extra from Title I get lost in 
the competition for the studen 's time and attention? The results 
showed that students served only by Title I worked in smaller groups 
than students in non-Title I schools. Students in Title I schools 
spent more time in activities which did not involve direct instructions 
(assemblies, school fairs, field trips, etc.) than did students in 
non-Title I schools. And students served by Title I and a bilingual 
program received substantially less reading instruction than the other 
students observed. 

Comments ; 

This paper was presented at the 1978 annual meeting of the American 
Educational Research Association in Toronto, Ontario, Canada. 



Publication Number 77.36 
(Occasional Paper) 



ABSTRACT 



Title : Can Researchers Find True Happiness In A Public School Setting? 
A Success Story In Bilingual Education Evaluation 



Contact Persons ; Glynn Llgon, Freda Holley 



No. Pages : 21 



Summary : 

Is productive research possible in a public school setting? Can 
the natural conflict between service oriented school personnel and 
research oriented evaluators be resolved? The ESEA Title VII Bi- 
lingual Program in Austin, Texas has encounteted both failures and 
successes in this area. Their experiences are presented here to 
illustrate that it is possible to design research around constraints 
encountered in the public schools t 

The narrative of this paper is written as a parable; however, the 
events represented here are based on actual happenings. Appendices 
are attached to provide the reader with definitions of the true 
variables and descriptions of the results obtained. 

A seeker of truth can find happiness in a public school setting if 
the constraints of the situation are considered and accepted before- 
hand. Truth-seeking and education can go hand-in-band» sometimes. 

Comments : 

This was a paper presented at the annual meeting of the American 
Educational Research Association, Toronto, Ontario, March, 1978. 




Publication No, 77,37 
(Occasional Paper) 



ABSTRACT 

^ Title; Changing Primary Evaluation Clients 



Contact Person: Freda Holley, Ph,D. 



No> Pa&ess 14 



Suipmary ; 

This paper discusses the adjustments an evaluation unit in an 
urban school district setting today must be prepared to make 
in response to a frequently changing environment* If the 
unit is to remain adapted to its context and supply information 
that has a chance of bringing about educational improvement, a 
change in ptimary clients may need to occur at various times. 
There are some tentative ideas about when such a client change 
may be necessary, what effects such a change may bring to the 
evaluation unit, and vhac the costs of such change may be. 



Comments : 

This paper was presented as a part of a symposium sponsored 
by the Center for the Study of Evaluatipn at the ''978 Annual 
Meeting of the American Educational Research Association in 
Toronto, Canada. The proceedings of the syposium are to be 
published as a monograph by the Center* 



Publication No. 77.38 
(Occasional Paper) 



ABSTRACT 

Title: Teacher Competency Testing: Your School District May 
Be Doing It Next 



Contact Person: Freda Holley, Ph.D, 



No. Pages : 40 



Summary : 

Around the co'intry school boards are beginning to call for 
teacher competency testing. When the Supreme Court upheld a 
lower court decision that the State of South Carolina could 
continue to use the National Teacher Exam despite the fact that 
the test had a "disparate racial Impact," it probably accelerated 
this trend., 

This paper describes the events in one school system associated 
with this trend. It particularly describes that system's 
experience with designing a test to assess bilingual teacher 
competency and a staff development program designed to improve 
that coirpetency. 



Comments : 

This paper was presented at the 1978 Annual Meeting of the 
American E.-acatlonal Research Association in Toronto, Canada 



Publication No. y7i39 
(Occasional Paper) 



ABSTRACT 

Tltle> Implementing a Minimum Competency Test Program 

Contact Perabna ; Mary Minter, James Watkins, Paula Matuszek, Ph.D. 

No. Pages ! 19 

Sunanary ; 

This is a discussion of the school district's efforts, to initiate a 
minimum competency testing program. The mijor difficulties experienced 
in dealing with policy issues, technical problems, and routine 
problems of implementation are identified and the rationale for the 
particular strategies selected are shared. 

Comments; 

This paper was presented at the Annual Meeting of the American 
Educational Research Association in Toronto, Ontario, March, 1978. 




Publication No. 77.40 



(Intarlffl Rtport) 



ABSTRACT 

Title ; Who Are the Dieadvantaged, and What Should We Do for Them? The 
. Relationship of Family Variablea to Achievement and Some 
Implicationa for Educational Programming 



Contact Person; Paula Matuszek 



No. Pages: 17 



Summary ; 

In the procc s of studying the achievement of low SES students, 
ch- Austin Independent School District found a wide variety of 
different ^/ariables which had been used to define SES and were 
supposedly related to achievement. In' the hope of illumlnatLag 
these relationships, we carried out a sur/ey of parents across the 
district to establish Income, education, attitude toward education, 
amount of. reading in the home, and a number of other variables. 
The relationship of these variables to achievement for second-and 
fifth-grade students is presented, and implications for program 
planning for disadvantaged children are discussed. 



Publication No. 77. Al 
(Occasional Paper) 



Title ; Data Processing Systems 
Contact Person ; Jim Watklns or 
No. Pages ; 27 



ABSTRACT 

for School District Testing Offices 
David Wilkinson 



Sumnary ; This paper develops a basic conceptual framework for data processing 
systems of school district testing offices. The framework consists of two 
components; the basic functions which a basic data processing system must 
perform, and the different classes of constraints under which any data 
processing system must operate. 

The framework is described generally and by the discussion of several 
different examples. These examples illustrate soue of the different types 
of data processing systems that might be utilized, each appropriate for a 
different combination of objectives and const Ints. 

The framework that is presented is that developed in the Austin Office of 
Research and Evaluation. It tepresents the result of two years of 
experience in managing a testing program. The framework is irtended to 
serve as a guide to other school districts which may be developing a 
data processing system or modifying an existing system. 



Comments ; 

This paper was presented at the 1978 Annual Meeting of the American 
Educational Research Association. 



Publication Nuabtr 77*42 
(Occatloiul Paper) 



ABSTRACT 

Title : Where Does The Time Go? A Study Of Time Use In Public Schools 
Contact Persons ; Joy Hester, Glynn Llgon 
No» Pages; 37 



Smmnary ; 

Day-long observations of students were conducted by the Austin ISD 
Office of Research and Evaluation during the 1976-77 school year 
as part of an effort to determine exactly how time In the school 
day was being used In Austin ISD elementary schools, Mlnute-by* 
minute observations of 227 randomly selected students In 32 schools 
yielded 1,475 hours of observation data. Information collected 
through teacher questionnaires provided somewhat leas extensive 
but relevant data related to Instructional time at the secondary 
level. Results of these studies were disturbing to many administrators 
who had assumed that most ol the school time avaii^nble was being 
used for Instruction, and changes In the system began to occur. 

C omments ; 

This was a paper presented at the annual meeting of the American 
Educational Research Association, Toronto, Ontario, March, 1978. 



Publication No. 77.43 
(Occasional Paper) 



ABSTRACT 

Title: Communicating Evaluation Information: Some Practical 
Tips That Work. 

Contact Person ; Freda Holley, Ph.D. 

No. Pages ; 38 

Summary ; 

This paper presents communication principles useful in the dissemina- 
tion of public school evaluation information. The information covered 
falls into six nujor areas: 

C 

* Evaluation Audiences 

* Evaluation Messages 

* The Written Medium 

* Veroal Presentations 

* Difficult Audiences 

* Working With the Press 

The authors recount many of their experiences related to dissemination 
of evaluation information and analyze the reasons for their failures 
and successes. 

Comments ; 

This paper was presented at the annual meeting of the American 
Educational Research Association, Toronto, Canada in March 1978. 
It is also slated for publication as a chapter in the book, 
How to Present an Evaluation Report (in press). 



Publlcaeion No 77.47 
(Occaalonal Paper) 



ABSTRACT 

Title : Selecting an Average 



Contact Person; Patsy Totuaek 



Not Pages ; A 



Sutnmary ; 

This paper defines mean, median, and mode, and describes the charac- 
teristics of each. Graphs are provided which show the relationship 
among the mean, median, and mode in normal and skewed distributions. 
The variables influencing the identification of an "average" score in 
a skewed distribution is discussed. 



